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1. An Overview of the Baccalaureate and Beyond Study 
1.1 Purpose of the Study 

The Baccalaureate and Beyond Longitudinal Study (B&B:93) tracks the experiences of a cohort of 
recent college graduates, more specifically, those who received the baccalaureate degree during the 1992-93 
academic year and were first interviewed as part of the National Postsecondary Student Aid Study (NPSAS). 
This group’s experiences in the areas of academic enrollments, degree completions, employment, public 
service, and other adult decisions will be followed for about 12 years. Ultimately, B&B:93 will provide data 
to assess the outcomes of postsecondary education, graduate and professional program access, and rates of 
return on investment in education. 

The National Center for Education Statistics (NCES) of the Office of Educational Research and 
Improvement (OERI), U.S. Department of Education, is conducting B&B:93/97 in partial compliance with 
the mandate stated in section 404(a) of the National Education Statistics Act of 1994, Title IV of the Improving 
America’s Schools Act of 1994, P.L. 103-382, which states: 

The duties of the Center are to collect, analyze, and disseminate statistics and other 
information related to education in the United States and in other nations, including... 
collecting, acquiring, compiling..., and disseminating full and complete statistics on the 
condition and progress of education, at the pre-school, elementary, secondary, and 
postsecondary levels in the United States, including data on. . . 

• student achievement at all levels of education; . . . 

• educational access to and opportunity for postsecondary education, including data on 
financial aid to postsecondary students; 

• teaching, including data on course-taking, instruction, the conditions of the education 
workplace, and the supply of, and demand for, teachers, which may include data on 
the proportions of women and men, cross-tabulated by race or ethnicity, teaching in 
subjects in which such individuals have been historically under represented; 

• the learning and teaching environment; and. . . 

conducting longitudinal studies as well as regular and special surveys and data collections, necessary 
to report on the condition and progress of education;... 



At the request of the Office of Management and Budget, and of other federal agencies interested in longitudinal 
data on recent bachelor's degree recipients, the data collection has been planned to extend over a twelve year 
period. 

1.2 Analytic Objectives 

As the 1992-93 cohort of college and university bachelor’s degree graduates advance through 
adulthood the effects of undergraduate education will become increasingly important. These include the effects 
of attending different types of colleges and universities (comprising different undergraduate programs, 
curricula and levels of academic achievement), on outcomes such as access to jobs, graduate and professional 
programs, and the rates of return for the individual and society from investments in postsecondary education. 
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For example, it will be important to determine how many college and university graduates require formal 
schooling beyond the baccalaureate degree to enter a desired career path or to continue working in a chosen 
field. 



B&B:93/97 will provide data related to attainment and outcomes of postsecondary education (PSE). 
Specifically, B&B:93/97 will address issues in three major areas of educational policy: attainment, access to 
graduate and professional programs, and the rate of return on investments in education. 

1) Attainment/outcome assessment. Continuing education, further degree completion, and entry into 
the work force are central to attainment and outcome assessment. Questions in this area include but are not 
limited to: 

• After completing a degree, how long does it take to enter the next level of graduate study or 
the work force? How many graduate degree recipients find work immediately that requires 
that level of education? How long does it typically take to obtain a position related to the field 
of study? 

• How often and for how long are people who completed a baccalaureate degree unemployed? 
Is unemployment related to field of study? 

• How does the level of educational debt incurred for the completion of undergraduate work 
affect decisions concerning graduate school, employment, and family formation? 

2) Graduate/professional program access. When graduates decide to enter into graduate or 
professional school after completing the bachelor's degree they encounter many of the same access and choice 
questions they faced when they initially entered into postsecondary education. In many areas, people must 
complete the graduate program to fully participate in the field. In other areas, graduate education enhances 
the ability to advance in the area, but is not required. The concern, of course, is that those who wish to 
continue their education beyond the baccalaureate level have the opportunity to do so. Questions to be 
addressed in this area would include but not be limited to: 

• What are the rates of graduate school retention and completion? 

• Do people who entered graduate school immediately after they completed a baccalaureate 
degree continue to progress and complete advanced degrees as originally expected? How 
long does it take to complete a graduate degree program? Does this vary by field of study, 
school type, age, or time of first entry into a postsecondary program? Does this vary if entry 
is delayed? 

• Are those who wanted to enter graduate school after gaining some work experience able to 
do so when they planned, or are they further delayed? Do they carry out the original plan 
or later decide against graduate school? How long do they delay entry? 

• Do students who had no plans for graduate school when they completed the bachelor’s degree 
later change their minds and attempt to enter? Do they have the access they would have had 
if they had attempted to enter immediately? Are there additional difficulties associated when 
students decide later to enter graduate school? 
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• Are people who were unable to enter graduate school immediately after completing the 
bachelor’s degree able to do so later? How long does entry take if people initially delay it? 

• At what rate do students change their mind about entering graduate school? 

3) Rate of return. Rate of return involves the concept of payoff, or the value of earning the degree, 
compared to the expenditures required to obtain it, both in terms of time and money. Rate of return can be 
viewed from two sides. For the individual, it can be viewed as monetary reward and personal satisfaction. 
For society, it can be viewed as the contribution a student makes through community involvement and public 
service (e.g., working in a public service area such as teaching, volunteer work, civic activity, or contributing 
in some other way to a societal need). For both the student and society, rate of return can also be viewed as 
the extent to which the student is adequately prepared to enter into work, civic, and cultural worlds with the 
ability to gain from and contribute to that experience. This study will look at rate of return both to the 
individual and to society. Questions to be addressed in this area would include but not be limited to: 

• Is there a difference in starting salary between those who first complete graduate school and 
those who do not? Is there a long term difference in salary? 

• How many people are eligible or qualified to enter a public service profession such as 
teaching? How many enter the work force full time in the area for which they are qualified? 
How long do they remain in that profession? Does this vary by level of degree? 

• Do those who enter public service positions advance in their jobs at the same rate as those in 
other areas? Does this vary by level of degree? 

• How frequendy do degree completers change jobs or careers? Does this vary by level of 
degree? Does this vary by time since degree completion? 

• Does the degree to which people volunteer vary by degree completed? Does it vary by length 
of time since degree completion? 

1 .3 Study Design 

The B&B:93/97 study is the second in a series of five followup interviews with a sample of over 
11,000 persons who received a bachelor's degree in the 1992-1993 academic year. Baseline data for the 
B&B:93 cohort were collected as part of the National Postsecondary Student Aid Study (NPSAS:93). The first 
followup interview (B&B:93/94) collected information from respondents one year after they received their 
bachelor’s degree, and collected undergraduate transcripts for each respondent. The second followup 
(B&B:93/97) will be conducted in the summer of 1997, four years after most respondents completed their 
undergraduate work. 

Subsequent interviews will take place at four-year intervals. The cohort will be followed for a 12-year 
period so that most respondents who attend graduate or professional schools should have completed, or nearly 
completed, their education and be established in their careers. 

1.4 B&B:93/96 Field Test 
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This report presents information on the Field Test that was conducted in the summer of 1996 in 
preparation for the main study, scheduled to begin in April, 1997. The field test follows a sample of 1,850 
individuals who were selected as part of the NPSAS:92 field test and comprised the sample for the B&B:93 
field test. 
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2. Field Test Design and Preparation 
2.1 Goals of the Field Test 

The field test was designed as a full-scale rehearsal of survey operations. The sample included the 
1,850 eligible baccalaureate degree recipients from the B&B:93/94 field test. The field test was designed 
to assess the quality and efficiency of the CAI (Computer Assisted Interview) instrument, systems, and 
procedures. 

1) Assess the quality of the survey instrument. The CAI instrument was designed to collect high 
quality data with as little burden as possible to respondents. To reduce respondent burden, the instrument 
made numerous use of respondent-specific skip patterns and text-fills utilizing preloaded data from previous 
interviews or responses to prior items in the current interview. The field test allowed us to test these skip 
patterns and text-fills using the full spectrum of responses. 

The field test was also essential for testing the on-line coding schemes used for coding schools, 
colleges, majors, industry and occupation. In addition, to ensure high quality data, a number of range and 
consistency checks were incorporated into the instrument. The results of the field test allowed us to examine 
whether these checks were too narrow or broad. 

Finally, the field test was designed to help provide data to improve the quality of the items to be 
asked in the main study. For example, 102 respondents were reinterviewed and asked a subset of items from 
the CATI interview to determine the reliability of those items. Consistency in responses, measured in terms 
of correlations or percent agreement, were calculated by comparing responses on the two surveys. These and 
other data quality checks are reviewed in chapters 5 and 6. 

2) Examine the efficiency of systems. Several systems support the data collection work on B&B: 
93/97, all of which have to work well together for the main study to succeed. The field test enabled us to 
thoroughly test each separate system, and also allowed us to identify problems in the interfaces between 
systems. The systems include the: 

• Integrated Monitoring System (IMS), which serves as the project archive for management 
activities, and contains all production and cost reports and project deliverables; all electronic 
project communications, as well as the data collection instrument and software and the 
monitoring system; 

• Instrument Development System (IDS), which provides a systematized and structured 
manner for describing a questionnaire’s appearance, technical parameters, and flow, and 
allows a smooth transition from questionnaire writing to instrument programming. 

• Telephone Number Management System (TNMS), the software used to manage the sample 
during telephone data collection (described in more detail in chapter 3); 

• Case Management System (CMS), a new multi-functional system designed to electronically 
transfer and manage cases across interviewers and the central office, provide information 
to project staff about the current status of all field cases, track hours and expense 
information on a daily basis, allow field interviewers instant access into the CAI instrument, 
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and provide the database tool that both telephone and field interviewers use to locate 
respondents and track locating attempts. 

A more detailed explanation and evaluation of the CMS is contained in Appendix A. The TNMS 
is a stable system; it is unchanged from B&B: 93/94 and no changes are planned for the 93/97 main survey. 
The only changes planned for the IMS are the recent revisions which enhanced COTR access to it via the 
internet by the design of a passworded web page which is connected to a server containing all the IMS 
reports, frequencies, and files. The IDS worked well; further enhancements have been made to upgrade the 
translator in order to automate more of the programming needed to produce the final instrument. 

One of the major goals of this field test was to determine the feasibility and cost-effectiveness of 
using computer-assisted personal interviewing (CAPI) in the main study. As in the first followup, initial 
interviews were conducted by telephone center interviewers using computer-assisted telephone interviewing 
(CATI). In the prior round, local field interviewers were used to follow up with respondents who could not 
be reached by phone center interviewers. In this field test, a subsample of cases that had not been completed 
after nine weeks of telephone production were assigned to field interviewers who had been trained in CAPI. 
NORC wanted to ascertain whether CAPI could be used effectively with an unclustered sample of 
respondents. (The cost effective use of CAPI during the field period is discussed further in chapter 3). 

3) Test and refine data collection procedures. Primary procedural goals of the field test included 
refining the protocols used for (1) locating and (2) gaining the cooperation of the B&B sample members; (3) 
training telephone and field interviewers as well as locators; and (4) making the transition between CATI 
and CAPI production. NORC also conducted an experiment as part of the field test. In this experiment, 
NORC examined the effectiveness of assigning difficult-to-reach and refusal cases to individual experienced 
telephone interviewers, using a case-ownership approach, rather than to field interviewers. A detailed 
discussion of these procedures and the results of the experiment are contained in chapters 2 and 3. 



2.2 Field Test Schedule 

The field test was conducted in the summer of 1996. Planning for the field test began almost seven 
months earlier with a meeting with the Technical Review Panel and the preparation of the OMB/IMCD 
clearance package. Major milestones in planning and conducting the field test are highlighted in the schedule 
provided below. 

October, 1995 Technical Review Panel meeting in Washington, D.C. 

Distributed materials included the list of proposed data elements for B&B: 93/97. 

December, 1995 OMB/IMCD clearance package submitted 

February, 1996 Field Test Plan submitted to COTR 

March, 1996 Prefield locating begins - address files sent to vendor 

NCES-supplied on-line coding systems reviewed 

April, 1996 OMB clearance received on April 8, 1996 

Affidavits of confidentiality signed 
Final advance letter address file prepared 
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May, 1996 



June, 1996 



July, 1996 



Teacher/Teaching Section Pretest, April 10-11 
CAI instrument reviewed with COTR 
Final training materials and trainer guides submitted 
Twenty-five interviewers selected 

Final CMS, TNMS, AQ preload files prepared 
Twenty Respondent/Full Instrument Pretest, May 6-7 
Respondent advance letters mailed May 6, 1996 
Interviewer training, May 8-11 
CATI Interviewing began May 13 

CATI interviewing continued 
Locator training, June 4-5 
Locating began June 6 

Telephone Center completes 1,255 cases 

Subsample of 250 remaining cases prepared for field interviewing 
Field/CAPI Manager training, July 1 1 
Field/CAPI Interviewer training, July 12 - 14 
Field/CAPI interviewing began July 16 



2.3 Instrument Development 

Technical Review Panel. The first Technical Review Panel Meeting (TRP) for the Baccalaureate 
and Beyond Longitudinal Study: Second Followup (B&B:93/97) was held on October 26 and 27, 1995 in 
Washington, D.C. Twenty-five people participated in the meeting, including NCES and NORC staff 
members. A list of panel members is included in Appendix B. 

The Technical Review Panel discussed each section of the survey instrument and made specific 
recommendations in each area. The panel stressed that it was important to spend interview time to collect 
data directly related to stated research goals. It was suggested that the only piece of retrospective data to be 
gathered was high school GPA. 

Revisions in the demographic, family, and loan sections of the instrument primarily focused on 
clarification of existing questions. For the education section, panelists suggested that detailed information 
on post-baccalaureate enrollment should be acquired for only three types of enrollments: the first enrollment, 
current enrollment and any enrollments that resulted in a degree. Panel members also suggested the inclusion 
of a new series of items about internships. They also recommended gathering a brief employment history 
along with detailed information about only one job, the one held in April of the current year. Suggested 
revisions to the teacher section included adding questions about movement into and out of teaching, and 
gathering information on substitute teachers and teacher’s aides as well. In response to TRP suggestions, 
NORC project staff and the NCES project officer prepared a list of data elements to submit for OMB/IMCD 
approval. 

Instrument development and pretesting. NORC subjected the instrument to rigorous review and 
testing prior to the field test. After review and testing by project staff, telephone center supervisors were 
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asked to conduct two pretests. The first pretest focused on the teaching section only, using a convenience 
sample of nine teachers. The second pretest involved the entire instrument, using twenty B&B: 93/97 field 
test sample members. The twenty respondents represented the first twenty interviews obtained with thirty 
sample members chosen at random. Telephone center supervisors conducted these pretests in April and May, 
1996. After each pretest, interviewers met with project staff to review items and suggest improvements. 

After the instrument had been revised as a result of the pretest, the instrument was reviewed by 
NCES staff. As a result of their suggestions, some of the screens were revised and the instrument was 
shortened. As was the case during the previous round of B&B, emphasis was placed on "conversational 
interviewing." A copy of the final instrument used in the field test is contained in Appendix C. Since the 
teaching section has numerous skip patterns dependent upon preloaded information and/or responses to prior 
questions in the instrument, a flow chart of this section is also included and appears in Appendix D. 

When the final instrument was approved, NORC revised question-by-question specifications for 
interviewers from the previous round and developed new specifications for new or modified items. These 
question-by-question specifications were reviewed and then incorporated into the electronic instrument. 

On-line coding systems. The B&B:93/96 instrument was designed to use five on-line coding 
systems developed by NCES. These coding systems allowed interviewers to code responses during the 

course of the interview; this provided interviewers with the opportunity to probe unclear or incomplete 
answers. Currently, systems have been designed to code occupation, industry, major fields of study, 
postsecondary schools attended, and, for teachers, the elementary and secondary schools at which they 
taught. 



The interviewers used the specialized coding system to code industry, occupation, or major, by 
entering a short accurate verbatim response to the question. The interviewer was then offered a choice of 
code categories which the system selected by matching the verbatim text with an underlying table. The 
interviewer could select one of the suggested categories, or choose to manually scroll through the response 
categories to select an appropriate code. The verbatim response and the interviewer's coded selection were 
saved so that the system could be revised, to in effect "learn" from respondents. 

The on-line system for coding elementary and secondary schools, and the system for coding 
postsecondary institutions, worked somewhat differently— verbatim responses were not recorded. Using these 
systems, interviewers asked respondents to name the state in which the school is located. After selecting the 
state from the list appearing on the screen, the interviewer asked the respondent to name the city in which 
the school is located. At that point, the system displayed all of the schools located in that city. To code the 
response, the interviewer cursored down to highlight the school the respondent named. A confirmation 
screen appeared to verify that the correct school was chosen. 

The coding programs functioned smoothly in the field test. The interviewers found that the job aids 
for the industry and occupation coding that they used in training and which NORC made available to them 
during data collection were very helpful. Both phone and field interviewers requested that a similar job aid 
be developed for them for the major fields of study. 
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2.4 Supervisor, Interviewer, and Locator Training 

Supervisor training. Four telephone center staff were selected to supervise data collection activities 
on the survey. One of the four, a telephone center coordinator, was assigned overall responsibility for all 
tasks associated with B&B:93/97, participating in the design phase of the field test by organizing and 
managing the pretesting of the CAI instrument, developing training materials and testing software and 
hardware. 

The coordinator trained the other supervisory staff. Using the materials developed for interviewer 
training, the coordinator walked through the modules prepared to teach the interviewer about the survey. The 
walk-through exposed supervisors to the substantive information unique to the B&B:93/96 field test and to 
the general information common to many education surveys. It also prepared supervisors to assist with 
interviewer training. Since two of the three supervisors worked on B&B:93/94, they were already familiar 
with the survey and coding programs; the revised teaching module was the only material which was new to 
them. The experienced supervisor who was new to the B&B study learned very quickly and was given some 
one-on-one training. 

Interviewer training. Twenty-nine interviewers were selected for B&B:93/96 interviewing. All 
interviewers had received eight hours of general training prior to working on their first NORC project. The 
general training consisted of standard NORC interviewing practices, procedures for completing time cards, 
and general telephone center policies. 

Twenty-six interviewers attended the three-day project training conducted between May 8 and 10, 
1996 (three interviewers selected for the training did not attend the session). Similar to the B&B:93/94 
interviewer training, this training contained modules consisting of lecture, demonstration, and hands-on 
experience in using CATI, on-line coding, and the TNMS (telephone number management system). The 
modules included the following: 

• Overview of B&B:93/96 Project 

• Confidentiality Procedures 

• Conversational Interviewing Techniques 

• Gaining Cooperation 

• Statistical Quality Control 

• TNMS 

• On-line coding of industry and occupation, postsecondary institutions (IPEDS), college 
course mapping, and elementary/secondary schools (ELSEC) 

Interviewers also participated in two group-led CATI mock interviews and two duo-mock interviews. 
This provided interviewers with hands-on practice with the questionnaire and CATI prior to actual 
interviewing. Interviewers also received homework assignments dealing with the materials covered each day. 

After project training, all interviewers went through a project certification process. Each interviewer 
completed a check-out mock interview with a supervisor or project staff member who evaluated the 
interviewer's knowledge and skills in CATI, gaining cooperation, TNMS, the five on-line coding programs, 
conversational interviewing, and how to probe unclear responses. Some interviewers required additional 
practice in specific skills before passing certification. Four interviewers needed practice in gaining 
cooperation; four in industry coding; five in occupation coding; three in using the conversational style; two 
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in probing unclear answers; and one in using online question-by-question specifications. Of the twenty-six 
interviewers who,completed the training, twenty-five completed and passed the certification process. One 
interviewer did not complete certification, because she decided that she was not suited to being an 
interviewer and removed herself from the project. 

Suggestions for interviewer training. The results of field test interview monitoring, interviewer 
feedback on the training, and the analysis of field test data suggest that interviewers may benefit from 
increased training and practice with industry, occupation, and major field coding, and recording graduate 
school enrollment periods. The training modules addressing industry and occupation coding should be 
revised to include exercises that are modeled on field test experience and allow more practice time for 
interviewers who are inexperienced with industry and occupation coding. An increased focus on recording 
verbatim responses would be useful in evaluating the accuracy of industry, occupation, and major field of 
study coding. During the debriefing, interviewers reported that it would be easier to code responses if they 
were more familiar with the conceptual definitions used to construct the code list; some of the code lists are 
long, and when interviewers are unfamiliar with the intent of the code list, their interviewing slows and 
affects the conversational style. Finally, interviewers can use more practice in recording postsecondary 
school enrollment periods since they find using that data capture to be screen awkward. Even so, overall, 
the interviewers stated that they thought the training was well organized, timed, and covered most issues in 
sufficient detail for them to feel prepared for the B&B:93/97 field test interview. 

Locator training. NORC conducted a two-day training session for locators, with eight B&B:93/97 
field test interviewers, on June 4 and 5, 1996. The training integrated use of the new Case Management 
System (CMS) with the locating procedures to be followed and various resources to be used. The training 
consisted of lecture, demonstration and hands-on experience. Specific modules for locators included the 
following: 



• Overview of the locating process and the new CMS 

• Accessing & using the parent/contact data 

• Updating respondent, parent, and contact locating information 

• Recording results of parent/contact attempts 

• Appropriate usage of credit bureau services, college alumni associations, graduate school 
registrar offices, military locating services, and state departments of motor vehicles 

• Using CMS to guide and track all locating activity and resource usage 



Two of the interviewers trained for locating removed themselves from the task. 

Suggestions for locator training. Locator feedback on the training, the locator debriefing held at 
the end of the CATI production period, the field interviewer debriefing, and review of the CMS locating 
data/call records indicated that the locators understood the locating process well, felt well-prepared to use 
the CMS to guide and track their locating activities, and, indeed, did use it well. However, the field 
interviewers received a general training module on field locating rather than this integrated locating/CMS 
usage module and the case call records associated with locating activity reflect this deficiency. Therefore, 
for the main survey, an integrated locating/CMS usage module should be substituted for the general locating 
training module. 
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2.5 Prefield Locating 

Locating data. The primary locating fields collected in B&B:93/94 and used to locate B&B: 93/97 
respondents are presented in table 2.1. 



Table 2.1- B&B: 93/94 data preloaded into the CMS 
to aid B&B: 93/97 respondent locating 

Telephone number at last contact attempt 
Address of respondent 

Telephone number for one or two parents of the respondent 
Address for one or two parents of the respondent 
Telephone number for contact person for the respondent 
Address for contact person for the respondent 
Respondent's social security number 
Respondent’s date of birth 

Respondent's drivers license number and issuing state 
Respondent's gender and race 

College which granted respondent’s baccalaureate degree 

Graduate school respondent attended in 1993, if applicable 

Final case status from B&B: 93/94 

SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



Suggestions for locating data. Both the locator and field interviewer debriefings indicated that 
locators used all of the data fields specified in table 2.1. In addition, they requested that the fields include 
addresses for each of the colleges and graduate schools, since several colleges and universities have similar 
names, which caused some confusion. 

Prefield locating procedures. Prior to the start of interviewing, NORC pursued four avenues to 
obtain updated respondent locating data. 

1. Two months prior to interviewing, NORC sent a database of the B&B: 93/97 field test 
sample member names, addresses and phone numbers to a vendor to update the information 
with National Change of Address (NCOA) data. 

2. A week before interviewing began, NORC sent an advance mailing packet to the updated 
addresses. The envelopes were stamped with "Forwarding and Address Corrections 
Requested." This stamp ensures that mailings are not only forwarded to respondents who 
have moved but that NORC would also receive the corrected addresses from the U.S. Post 
Office. 

3. The advance packets included a letter which asked respondents to notify NORC of any 
changes in their phone numbers or addresses since they were last interviewed. A toll-free 
phone number for NORC’s telephone center as well as a direct phone number to the NORC 
project director was provided. 
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4. NORC also provided a B&B-specific e-mail address in the letter, as an additional venue for 
respondents to use to update their phone numbers and addresses. (The phone numbers and 
e-mail address were also included in an enclosed leaflet that described the project in more 
detail.) 



Table 2.2 displays the results of these four pre-field locating approaches. 



Table 2.2--Prefield updates of respondent locating data 


Source 


Updates received 




Number of cases 


Percent of total cases (1,850) 


NCOA vendor 
on 3/9/96 


523 


28% 


P.O. address changes 
after 5/8/96 


104 


6% 


Respondent e-mail 


16 


1% 


Respondent calls 


135 


7% 


Total 


778 


42% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



Although updated information was obtained for 778 cases, or 42 percent of the total sample, some 
of the information received from the various sources was redundant, while other information was itself 
quickly outdated. These problems are exemplified by the 104 additional address changes received from the 
post office; these changes apparently occurred in the two-month period before the field-test but after receipt 
of the address changes from the NCOA vendor. While these results may be an indicator of the high mobility 
of this sample, they also suggest that NCOA databases may not be current or complete. 

The post office address updates do not include telephone numbers. Directory assistance calls elicited 
only 36 published phone numbers associated with the 104 new addresses. Furthermore, thirteen 
of these 36 new phone numbers had already been identified through other sources. Therefore, the final count 
of cases located solely through the U.S. post office address corrections was only twenty-three, or less than 
1 percent of the total sample. 

Respondent e-mail and phone calls, while low in relative numbers, compared to the NCOA and post 
office address changes, were the best of all prefield locating attempts, in terms of quality and the 
completeness of locating data obtained. The eighteen e-mails and 135 phone calls not only provided both 
current addresses and phone numbers but also, in many cases, indicated the best time or best day to be 
interviewed. 

Suggestions for prefield locating. For the main survey, NORC will use the National Student Loan 
database as a first step in our prefield locating effort. For those sample members not identified in the student 
loan database, NORC will use a credit bureau search based on respondent social security numbers, since this 
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resource proved very successful in obtaining updated address and phone numbers for our respondents in this 
field test (discussed in detail in section 3.3.). 

Of course there will still be a substantial quantity of respondents whose addresses and phone 
numbers will still be outdated even after the credit bureau check. Because the information obtained from the 
post office was redundant and tardy, and because the locating data obtained from respondent e-mails and 
calls was of high quality, it would be helpful to hasten the return of the post office information and increase 
the percentage of respondent e-mails and calls that NORC receives for the main survey. This could be 
accomplished by sending out the advance mailing at least two weeks prior to the start of interviewing and 
stressing in the advance letter that respondents can not only call or e-mail us their updated phone numbers 
and address but also convey to us the days and times that are most convenient for them to 
be interviewed. 




21 



Chapter 2 - Page 13 



Baccalaureate and Beyond 
Field Test_ Report, 7 996 



3. Field Test Procedures and Evaluation 

Overview. An initial mailing was sent to all 1,850 potential respondents on May 6, 1996, inviting 
them to participate in the study. The mailing included a letter which appears in Appendix E. The letter 
provided a summary of the survey objectives, an introduction to NCES and NORC, and a promise that the 
study would stricdy adhere to the privacy protection laws. Telephone interviewing began on May 13 and 
continued until July 13, 1996, a period of 8 Vz weeks. At the end of this time, a sample of 250 of the 542 
pending cases were selected for further follow-up in the field. As outlined in the original proposal, pending 
cases were sampled to contain costs during the field test. The 250 cases were sent to field interviewers and 
worked from July 16 through September 10, 1996, a period of eight weeks. 

Figure 3.1 summarizes the flow of cases through the major activities in the B&B:93/97 field test. A 
summary of these data collection activities is presented in this overview; where appropriate, references are 
provided to specific sections for further details. 

Case records for the field test sample were loaded into the CATI telephone number management 
system (TNMS) and delivered to interviewers. Cases were delivered initially during peak contacting periods 
which included Monday through Thursday evenings, Saturday mornings, and late afternoon and evening hours 
on Sunday. A total of 1 ,255 cases, 68 percent of the initial sample, were completed in-house. An analysis 
of case delivery management is presented in section 3. 1 and CATI production is described in section 3.2. 

Locating problem cases were initially sent to a credit bureau database service to obtain updated 
information about the respondent. If no updated phone number was obtained through this process, or if an 
updated phone number was subsequendy identified as being incorrect, the case was sent to locating specialists. 
As figure 3.1 indicates, 598 cases (32 percent of the initial sample) required this intensive locating. Of these, 
292 were eventually completed in the phone center, 176 were finalized prior to, or not fielded during, the 
CATI-CAPI transition, and 130 were sent to the field. Of the fielded cases, 35 had actually already been 
located but no interview had yet been completed. Section 3.3 describes and analyzes the locating process. 

Two hundred thirty respondents (14 percent of the total sample) initially refused to participate in the 
B&B:93/97 field test. CATI refusal conversion specialists were able to persuade more than half (59 percent) 
of these initial refusals to cooperate, completing interviews with 136 of them. Of the remaining refusal cases, 
60 were sent to the field (half to field interviewers, half to the phone center experiment group) and 34 were 
either finalized as reftisals prior to, or not fielded during, the CATI-CAPI transition. More information about 
the refusal conversion effort is presented in section 3.4. 

The remaining 60 CATI cases that were sent to the field were “maximum call” cases, cases which had 
received more than a dozen calls without yet completing an interview. More information on maximum call 
cases is provided in sections 3.1 and 3.5. 

After telephone interviewing was halted in mid-July, field interviewers were sent a sample of 250 
cases selected from those still pending. The field completed 135 or 54 percent of their assigned cases, 
increasing the final response rate for the B&B: 93/97 field test to 90 percent. Field activities, including a 
discussion and analysis of the field/phone center case management experiment, are described in section 3.6. 
Final response analysis appears in section 4.1. 
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Figure 3.1 -Paths Toward Case Completion 
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3.1 Telephone Interviewing Case Management 

The CATI telephone number management system (TNMS) is NORC's standard call scheduling and 
telephone number delivery system. The system is responsible for routing cases to interviewers at the most 
opportune times for telephone contact. Interviewers record call outcomes for each case in the TNMS and the 
system chooses the next appropriate action depending on the last outcome, and history of outcomes, for the 
case. 



The TNMS tracked the status of cases in the B&B:93/97 field test using a location flag attached to each 
case. The case delivery module of the system delivered cases which were in the general interviewing location 
to general interviewers. Cases in all other locations were either accessed direcdy under the directions of a 
supervisor, or delivered only to specialized interviewers, for example, refusal conversion specialists. The 
location flag was automatically updated by the system depending on the outcome code provided by the 
interviewer. The B&B: 93/97 field test locations are presented in table 3.1. 



Table 3.1— TNMS locations 


Location 


Meaning 


1 


General interviewing 


2 


Refusal conversion 


3 


Locating (needs locating) 


4 


Maximum calls (at least twelve calls have been made with no contact) 


5 


CMS (in locating) 


6 


B&B: 93/94 refusals 


7 


Holding tank (cases that have not yet been released) 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



At the start of the field period, all known locating problems were loaded into location 5 (CMS [in 
locating]); all refusal cases from the previous round of B&B were loaded into location 6 (B&B:93/94 refusals); 
and the remaining sample was loaded into location 7 (holding tank). Throughout the field period, supervisors 
would use a batch process to move unworked cases from the holding tank location into the general interviewing 
location; cases were moved in replicates of 200. This was done to ensure that the cases in general interviewing 
were being efficiently worked before additional cases were added. 

Respondents who refused to complete the interview were coded as refusals by the interviewer and 
automatically routed to a supervisor review queue. After a short cooling down period of two weeks, the 
refusal cases were routed to a refusal conversion specialist to be worked. If the respondent could not be 
converted, the case was coded as a second refusal and marked to be sent to the field. When a case was 
identified as a locating problem it was filed to Location 3 . Each night the system automatically scanned new 
cases placed into location 3, loaded them into the Case Management System (CMS) locating database, and 
moved them to location 5 (CMS [in locating]). These cases remained there until the locating information had 
been updated and the case could be re -activated for interviewing in the TNMS. 
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Calling algorithms. The calling times and case routing schedule set up for the B&B:93/97 field test 
was based on our B&B: 93/94 experience that indicated that the best times to reach sample members were 
Monday through Thursday evenings, Saturday mornings, and Sundays during the late afternoon and evening. 
Initial calls were not scheduled on Friday, late Saturday afternoon and evening, and early during the day on 
Sunday. However, interviewers worked these hours to service any appointments set up by respondents during 
these times. The telephone center was in operation from 8:00 a.m.-l 1 :00 p.m. on Monday through Thursday, 
8:00 a. m. -9:00 p.m. on Friday, 8:00 a. m. -7:00 p.m. on Saturday, and 11:00 a.m.-l 1:00 p.m. on Sunday. 

Cases were delivered to interviewers by the TNMS initially up to 13 times before being filed to 
Location 4 (Maximum Calls, which indicates difficult-to-reach respondents whose phone numbers have been 
called several times with no contact made). The weekly calling algorithm reflected the above preference for 
Monday through Thursday evenings, Saturday mornings, and Sunday evenings. Cases were delivered twice 
during each evening Monday through Thursday (8), once on a weekday morning (1), once on a weekday 
afternoon (1), once on Saturday morning (1), and once on Sunday evening (1). If no contact had been made 
with the respondent after the twelfth call had been made (indicating that the entire algorithm cycle had been 
covered), the case was reviewed by a supervisor. The supervisor would decide either to send the case back 
to the floor to be called during an off-cycle period, or to send the case to locating. 

Appointment setting. The calling delivery cycle was stopped as soon as an appointment was set to 
call the respondent. From that point forward, appointments determined when the respondent was called. 
Project staff expected that many respondents would try to delay the interview because of their busy lifestyle; 
therefore, interviewers attempted to complete the interview when the respondent was initially contacted and 
to not let the respondent delay the interview. However, appointments were still very common. Sixty-three 
percent of the completed cases made at least one appointment at some time during the Phone Center field 
period. 



When analyzing post-production appointment data, it is difficult to distinguish between ‘hard’ 
appointments, when an interviewer and respondent have established a specific time for the respondent to be 
called back in order to be interviewed, and soft appointments, for example when the TNMS automatically set 
an appointment based on certain outcomes such as a “no answer” on an already scheduled appointment. A total 
of 2,953 appointments of both kinds were made throughout the telephone center production period. 

The TNMS scheduled appointments only when the Phone Center was staffed. However, the number 
of appointments that could be made at any one time could not be constrained, making it possible that too many 
appointments could occasionally be scheduled for a particular time given the number of interviewers available. 
To minimize this risk, the workload in the Phone Center was structured to ensure that sufficient interviewers 
were scheduled to call all respondents with known appointments. Missed appointments occurred when no 
interviewers were available to call the respondent within a 25 minute time span around the appointed time. 
With these safeguards in place, 82 percent of all appointments, both soft and hard, were kept. The majority 
of missed appointments occurred either during weekday mornings (37 percent) or weekday afternoons (26 
percent) and were soft appointments where the interviewer had selected a time. Missed morning appointments 
were not scattered throughout the morning shift, but rather scheduled for the same time, usually the earliest 
allowable time to call a respondent in a given time zone. Similarly, missed afternoon appointments were not 
scattered throughout the shift, but scheduled for the same time, most frequently noon. To ensure a lower 
percentage of missed appointments in the main survey, interviewers will be trained more on the need to stagger 
the times for which they schedule soft appointments and project staff will review appointment data daily. 
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3.2 CATI Production 

Data collection began on May 13, 1996. Week-by-week production and cumulative completes are 
diagramed in figure 3.2. At the start of data collection, the number of completed cases per week followed a 
standard pattern for CATI production. In the first two weeks, there was an increase in weekly production as 
all the interviewers were certified and placed into production; the second week was the best week for 
production with 217 CATI interviews completed that week. The subsequent weeks showed steady production 
with only minor fluctuations from week to week. What differs from a standard CATI production period is that 
production did not drop off substantially during the last couple of weeks. This indicates that cases were still 
being worked quite productively in the phone center immediately prior to their release to the field. However, 
due to the decision to curtail the overall production period in order to retain funds for the main survey, NORC 
stopped phone center interviewing sooner than it otherwise would have been stopped, in order to allow a 
thorough testing of the CAPI field interviewing procedures as well. In the main survey, NORC will work 
cases more extensively and for a longer period of time in the phone center before they are sent to the field. 



The minor fluctuations in production in the period between June 1st and July 15th are evidence of the 
relationship between interviewing efficiency and number of cases available to the interviewers. Productivity 
decreased slightly between May 25th and June 15th as weekly hours per complete rose due to an increase in 
refusal conversion effort, more cases reaching the maximum calls limit which required supervisor review, and 
an accumulation of cases in the locating center. When locating specialists began working on June 5th, cases 
were located and sent back to interviewers, and the additional availability of cases was associated with a slight 
increase in production between June 9th and June 29th. Production again dips temporarily during the week 
ending July 6th, in part because staff identified additional locating problem, refusal, and maximum call cases, 
and in part because of the 4th of July holiday. During this time period, efforts were successfully concentrated 
upon locating problem cases and production again increases during the last week when interviews were 
completed with the newly located respondents. Starting the locating effort earlier during the main study 
should produce a more even trend in production. 
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Figure 3.2-CATI completed interviews by week 
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Figure 3.3 displays the average number of hours per completed interview by day of the week. This 
data is obtained by dividing the total number of interviewer hours by the total number of completes obtained 
for each day of the week throughout the CATI production period. The graph indicates that Fridays were not 
particularly effective days to call respondents, since interviewers spent an average of more than four hours 
of time attempting to contact and interview respondents for each interview they were actually able to complete. 
This result compares to an average of approximately only two and one half hours of contact and interview 
attempts on each of the other days of the week. In fact, Mondays, Wednesdays, and Sundays were slighdy 
better days than Tuesdays, Thursdays, and Saturdays for reaching respondents at home. When data was 
reviewed by hour of day as well as day of week, respondents were found to be most likely to complete an 
interview on a weekday evening, Saturday morning, and Sunday evening than at any other time. NORC will 
adjust initial interviewer staffing and calling algorithms for the main survey to reflect these findings, and will 
watch them closely to observe any differences which would require additional adjustments. 




Maximum calls. B&B:93/97 respondents were found to be an active, busy group and somewhat 
difficult to reach at home. Figure 3.4 displays the relationship between the number of telephone calls made 
and the number of CATI interviews completed. While the first call is more likely than any other call to result 
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in a completed interview, still only 174, or 14 percent of CATI interviews were completed with only one 
telephone call. However, 60 percent of the CATI cases (748) were completed by the sixth call while 82 
percent (1,035) were completed with twelve or fewer calls. Note that whereas 46 percent of the CATI 
interviews were completed between the second and sixth call, only 22 percent of additional cases were 
completed between the seventh and twelfth call. Because cases were backed up in locating, towards the end 
of the CATI production period, for many of the remaining cases, more than twelve calls were made. As 
Figure 3.4 indicates, the higher number of calls are associated with substantially diminishing rates of returns, 
with the eighteenth call accounting for less than one percent of completed CATI interviews. (See further 
discussion about maximum call cases in section 3.5, regarding the results of the phone center case ownership 
experiment for maximum call and refusal cases during the field period.) 



Figure 3.4-Number of calls to complete Interview 
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3.3 Respondent Locating 

Cases requiring locating were an extensive problem for the B&B: 93/97 field test: 917 cases, half of 
the initial sample, required some kind of locating effort during the production period. This locating was in 
addition to the prefield locating activities explained in section 2.5. However, phone center and field locators 
were very successful and ultimately they located all but one percent of the net sample and completed interviews 
with 87 percent of the eligible locating problem cases. 

Protocol used for locating. Figure 3.5 summarizes the locating process used during the field period 
for the B&B: 93/97 field test. In the accompanying text, references are provided in parenthesis to specific 
figures and tables that provide more detailed information about that particular component. 

Cases were loaded into the TNMS with the “best” telephone number for reaching the respondent based 
on the information obtained through our prefield locating efforts. Interviewers identified cases that required 
locating activity when the TNMS delivered a number that was “wrong,” either because it was a non-working 
number for which no additional information was available or because the party reached was not the respondent 
and had no knowledge of the respondent. (Table 3.2 contains information about the extent of locating 
required.) 

The first time these cases were identified as having an outdated telephone number for the respondent, 
their social security numbers were automatically sent to Equifax to obtain updated address and phone 
information from the credit bureau’s databases. If updated information was obtained which included a new 
phone number, or for which a new phone number could be obtained from directory assistance, the case was 
immediately returned to the TNMS general interviewing location. The newly-obtained phone numbers were 
not called by locators to verily if they were correct. If this updated number was subsequendy identified as also 
being incorrect, the case was then sent to the Phone Center Locating Specialists. (Table 3.3 displays the 
results of the initial Equifax inquiries.) 

Locators used the CMS to both guide and track their efforts. The CMS contained the specific 
preloaded locating data that the locator had to access for each case as well as locator-entered records of which 
resources had already been used and with what result, including any updated phone and address information 
obtained for respondents or their parents or contacts. Locating specialists were instructed to use the following 
resources in the order they appear since the order correlates to their past proven utility in locating sample 
members: 1) last known telephone number of the parent(s); 2) last known telephone number of a contact 
person; 3) reverse Transunion (“reverse” indicating a search on last known address rather than social security 
number since the Equifax inquiry had already been done on social security number); 4) bachelor degree school 
alumni office; 5) graduate school or military locating service if applicable; and 6) Department of Motor 
Vehicles in the state which issued the respondent’s last known driver’s license. (Table 3.4 presents the 
frequency and effectiveness of use associated with each of these six major locating resources utilized by the 
Locating Shop.) 
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Some cases remained unlocatable at the close of telephone operations; a sample of these was 
distributed to field interviewers (95 of the 130 cases that had ever been in locating). In addition, 23 of the 
maximum call and refusal cases that were fielded also ended up requiring some locating effort in the field. 
A record of all locating activities engaged in by the Locating Shop as well as any updated address information 
acquired for each of their assigned cases was accessible to the field interviewers through the CMS loaded into 
their computers. Upon review of the CMS call records for their cases, field interviewers could use the 
resources listed above that had not yet been accessed or could use additional resources because of their regional 
knowledge not available to the phone center locators (such as voter registration offices, utility companies, tax 
assessors offices, churches). (Table 3.5 indicates the final case dispositions by locating problem status for both 
phone and field cases.) 

Extent of locating effort. Although the proposal had projected that 30 percent of cases would need 
to be located, as table 3.2 indicates, about half of all cases required some locating (where “locating" is defined 
as the association of a case with at least one of the following: an automated Equifax check, assignment to a 
phone center locating specialist, or identification of the case as being a locating problem by a field 
interviewer). Approximately one third of all cases required the more intensive efforts of the phone center 
locating specialists. Fewer of the cases that were eventually completed required locating than those which 
were finalized as non-respondents or not fielded. 



Table 3.2-Extent of locating task 


Final status 


Required no 
locating 


Required some 
locating 


Required locating 
specialist effort 


Completes (1,390) 


795 


57% 


595 


43% 


369 


27% 


Nonrespondents (160) 


71 


45% 


91 


56% 


56 


35% 


Ineligibles (6) 


1 


17% 


5 


83% 


3 


50% 


Not fielded (292) 


66 


23% 


226 


77% 


170 


58% 


Total (1,850) 


933 


51% 


917 


50% 


598 


32% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



Automated Equifax inquiries. Table 3.3 displays the successful results of NORC’s decision to use 
an automated process to gather batches of "first time" wrong numbers and submit them to Equifax to obtain 
updated address and phone information. Of the 837 cases submitted to Equifax, new addresses were obtained . 
for 79 percent, or 665, of the cases, and new phone numbers were obtained for 58 percent, or 486, of the 
cases. The cases for whom only an address was available had unpublished phone numbers. 

Since the first call to a respondent is more likely to result in a completed interview than any other call, 
the new numbers obtained from Equifax were not verified by a locator but rather were entered into the case 
records and returned directly to the TNMS for delivery to an interviewer to try. Of the 486 new numbers, 
interviewers subsequently found that 191 of them were also incorrect. These 191 cases were then sent to 
phone center locating specialists along with the 183 cases with new addresses but unpublished phone numbers, 
the 168 cases for whom no new information was obtained from Equifax, and 56 additional locating problem 
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cases which were identified by supervisors when they reviewed maximum call cases. However, it is important 
to note that 295 cases (486-191), or more than one third of the cases that were submitted to Equifax, did not 
ever require any additional locating efforts (see far right box in Figure 3.5). 



Table 3.3--Results from initial automated Equifax inquiries 


Result 


N 


% of Equifax inquiries 


Fail: same address/same phone 


168 


20% 


Lead: new address/same phone 


183 


22% 


Find: same address/new phone 


4 


<1% 


Find: new address/new phone 


482 


58% 


Total 


837 


100% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



Phone center locating. About one third of the initial sample, 598 cases, required the attention of 
NORC’s phone center locating specialists. Locators were able to successfully locate and return 340 of these 
cases to CATI interviewers. Forty-eight of these cases, as well as 128 unlocated cases, were not fielded. 
Table 3.4 summarizes the usefulness of each of the major locating resources used by the locating specialists 
during the field test. Utility is indicated both by the number of finds associated with each resource as well as 
the number of leads associated with each resource. Finds are defined as those instances when use of the 
resource resulted in obtaining a new phone number for the respondent. Leads are defined as those instances 
when new locating information, that does not include a new phone number, is obtained for a respondent. For 
comparison purposes, the table also includes finds and leads associated with usage of the automated Equifax 
inquiries. Please remember that locators were instructed to use these resources as much as possible in the 
order that they appear; therefore, these figures do not represent independent resource efficiencies. 
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The data used to create table 3.4 is case-level data. In other words, the number which appears in the 
second column, entitled “Usage,” refers to the number of cases (respondents) for which this resource was used, 
the third column refers to the number of respondent phone numbers locators successfully found when they used 
this resource (expressed as a percentage in column six), and the fourth column refers to the number of 
respondents for whom use of this resource elicited new leads, i.e. locating information but not a new phone 
number (expressed as a percentage in column five). Using the resource of ‘parent information’ as an example, 
the table indicates that contacts were made or attempted with the parents of 377 respondents. New information 
was obtained from respondents’ parents for sixty percent of these respondents; in fact, 95 percent of this new 
information included the respondent’s current phone number (thus a 57 percent successful ‘find’ rate). 
Therefore, while parent information elicited less new leads than did Equifax, it resulted in substantially more 
finds, or new current phone numbers. When parent information did not result in a lead or find, this was 
primarily because locators could not actually speak with the parents (calls resulted in repeated busy signals, 
unanswered ringing, or answering machines, or were disconnected numbers for which no further information 
was available). 

To summarize the resource usage results, table 3.4 evidences that parent and contact information given 
by the respondent in a prior interview is by far the most useful locating information available. Parents were 
associated with finding 57 percent of all respondents who required phone center locating; contacts were 
associated with finding 44 percent of them. The third best resource, in terms of successfully finding the 
respondent, was the alumni association or registrar's office of the respondent's bachelor -degree granting 
institution or graduate school which he/she attended in 1993. The use of the word “reverse” in front of 
Transunion refers to submitting an inquiry that is run on the respondent’s last known address rather than the 
social security number since the initial Equifax inquiry was already run on the social security number without 
effective result. The table indicates that a reverse credit bureau check can be effectively used for those cases 
which have not been found through use of the parent, contact, or postsecondary institution information. 
Finally, locators used military locating services and state department of motor vehicles (DMV) resources on 
few cases, and the data indicates both that not many of our sample members are currently in active military 
service, and that state DMV’s are not a very effective locating resource. However, this conclusion about the 
DMV resource must be qualified: two DMV responses with updated respondent information were received 
but not until several weeks after the field period had ended; therefore the long time delays between requests 
and responses could account for much of the non-utility indicated in the table. 
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Table 3.4--Phone center locating effort: Locating resource usage and 

results 


Resource 


Usage 
(by # of 
cases) 


"Finds" 
related to 
usage 


"New leads" 
related to 
usage 


Efficacy rate: 
finds & leads 
per use 


Success rate: 
finds per use 


Automated 

Equifax 


837 


295 


374 


80% 


35% 


Parent 

information 


377 


213 


12 


60% 


57% 


Contact 


179 


79 


20 


55% 


44% 


Transunion 


155 


17 


45 


40% 


11% 


College/ 
Grad school 


78 


17 


16 


42% 


22% 


Military 


3 


0 


2 


67% 


0% 


DMV 


22 


0 


0 


0% 


0% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test. 1996 
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Final completion status by locating problem status. Table 3.5 shows that while 85 percent of cases 
that never required locating were completed, only 65 percent of all cases which required locating were 
completed. Looking only at the net sample (excluding the cases in the ‘not fielded’ column), 92 percent of 
cases that did not need locating were completed compared to 86 percent of cases that were locating problems. 
Thus, NORC were quite successful in locating and completing interviews with these respondents. 



Table 3.5- 


Final completion status by locating problem status 










Complete 


Final 


Unlocated 


Other 


Not 


Ineligible 


Subtotal 






refusal 




Non- 

Response 


Fielded 






Ever 

needed 

locating: 
















Phone 


478 


9 


0 


2 


226 


1 


716 




52% 


1% 


0% 


<1% 


25% 


<1% 


78% 


Field 


117 


20 


16 


44 


0 


4 


201 




13% 


2% 


2% 


5% 


0% 


<1% 


22% 


Subtotal 


595 


29 


16 


46 


226 


5 


917 




65% 


3% 


2% 


5% 


25% 


<1% 


100% 


Never 

needed 

locating: 
















Phone 


111 


37 


-- 


3 


66 


1 


884 




83% 


4% 




<1% 


7% 


<1% 


95% 


Field 


18 


14 


— 


17 


0 


0 


49 




2% 


2% 




2% 


0% 


0% 


5% 


Subtotal 


795 


51 





20 


66 


1 


933 




85% 


6% 




2% 


7% 


<1% 


100% 


Total 


1,390 


80 


16 


66 


292 


6 


1,850 


— Not applicable. 














SOURCE: 


NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 
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Refusal conversion calls began about four weeks after the start of data collection. Three B&B:93/97 
field test interviewers, who were experienced at refusal conversion, were selected to convert refusal cases. 
The interviewers attended a briefing that included a review of the types of refusals and a round robin practice 
of exercises in gaining cooperation. The CATI refusal converters were very successful; they were able to 
convert and complete 136 of the refusal cases and another 23 cases were converted by field interviewers. In 
all, NORC interviewers were able to convert 159 (52 percent) of the 306 refusals (compared to 41 percent of 
the B&B: 93/94 refusals). Table 3.6 indicates the refusal problem and the overall conversion success rate. 

Looking only at the net sample (excluding cases that were not fielded or ineligible), interviewers 
completed 59 percent of the refusal cases, compared to 96 percent of cases that were never refusals. 

3.5 Field Operations 

In early July, the main telephone center ceased work on the B&B:93/97 field test. Of the 542 pending 
cases, 250 were selected for further followup. All were cases that the telephone center had been unable to 
complete because the respondent refused (60 refusals), was difficult to reach (60 maximum calls), or had 
required locating (130). These 250 cases were assigned either to field interviewers (190 cases) or to a phone 
center case-management experiment group (60 cases). The field interviewers received all 130 of the locating 
cases as well as half of the refusal cases (30) and half of the maximum call cases (30). The phone center case- 
management experiment group received the remaining refusal (30) and maximum call (30) cases. 

Both field interviewers and the phone center case-management group were CAPI (computer-assisted 
personal interviewing) interviewers, receiving and working their cases using laptop computers on which the 
CAI instrument had been loaded as well as the electronic case management system (CMS) which contained 
all the locating information and call records associated with each case they were assigned as well as 
information about the current status of that case. 

Field manager and interviewer recruiting and training. Three field managers (FMs) were hired 
to supervise nine telephone field interviewers. Each manager was responsible for a specific geographic region 
of the United States. In-person field interviewers were recruited and hired as needed contingent upon the 
location of cases. A total of ten in-person field interviewers were hired for the B&B.93/94 field test. 

The three field managers received one-half day of in-person training on managing cases and interviews 
using the CMS and two days of concurrent CAPI interviewer training. The nine telephone interviewers 
attended a two-day CAPI telephone interviewer training on locating, refusal conversion skills, the 
administration of the questionnaire, using the CMS to record contact attempts and locating information and 
the entering of cost information. In-person interviewers were trained via a telephone conference call during 
which they completed a mock interview, reviewed assigned case(s), developed strategies for completing the 
case(s) and reviewed administrative procedures with their Field Manager. 
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Table 3.6— 


Final completion status by refusal status 










Complete 


Final 

refusal 


Unlocated 


Other 

non- 

response 


Not 

Fielded 


Ineligible 


Subtotal 1 


Ever 














306 


refused: 














17% 


Phone 


136 


46 


0 


i 


34 


0 


217 




44% 


15% 


0% 


<i% 


11% 


0% 


71% 


Field 


23 


34 


4 


26 





2 


89 




8% 


11% 


1% 


9 % 




1% 


29% 


Subtotal* 


159 


80 


4 


27 


34 


2 


306 




52% 


26% 


1% 


9% 


11% 


1% 


100% 


Never 














1,544 


refused: 














83% 


Phone 


1,119 


— 


0 


4 


258 


2 


1,383 




73% 




0% 


<1% 


17% 


<1% 


90% 


Field 


112 


— 


12 


35 





2 


161 




7% 




1% 


2% 




<1% 


10% 


Subtotal* 


1231 





12 


39 


258 


4 


1,544 




80% 




1% 


3% 


17% 


<1% 


100% 


Total 


1,390 


80 


16 


66 


292 


6 


1,850 


-- Not applicable. 

* Percentages may not add to 100% because of rounding. 

SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 
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Phone center case-management experiment group training. Two B&B:93/97 phone interviewers 
with field test experience were retained for the Phone Center case-management experiment. They were 
supervised by one of the experienced Phone Center supervisors. The supervisor attended the same half day 
in-person training on managing cases using the CMS as the field supervisors. The phone interviewers were 
already thoroughly familiar with locating, refusal conversion, administration of the B&B questionnaire, and 
use of the CMS to record contact attempts and locating information. They both received an additional two 
hours of training on use of the laptops, the differences in the CAPI CMS program, which differed slightly 
from the locating CMS program with which they had experience, and entering of cost information, as well as 
full utilization of a case management approach, which allowed them complete scheduling flexibility with 
respondents (in contrast to adherence to a predetermined work schedule). 

Field production. Of the 250 subsampled cases, 190 were assigned to the telephone field interviewers 
(130 from locating, 30 refusals, 30 maximum call cases) and 60 were assigned to the phone center case- 
management experiment group (30 refusals and 30 maximum calls). Of the 190 cases assigned to the 
telephone field interviewers, when an interview could not be completed by telephone, the field manager 
determined if NORC had an interviewer within 50 miles of the respondent. If an interviewer was available, 
the case was assigned to a local interviewer to work in person. 

A total of 135 interviews were completed during the field period at an average of six hours per 
completed interview. The telephone field interviewers completed 103 interviews; three interviews were 
completed by in-person interviewers. The phone center case-management experiment group completed 
twenty-nine interviews. The use of CAPI was determined to be both feasible and cost-effective insofar as the 
cost of the CAPI field cases (both those conducted by the field interviewers and those completed by the phone 
center experiment group) was even less than had been expected. 

Table 3.7 displays the experiment results. The experiment cases (maximum calls and refusals) were 
apparently the more difficult interviews to obtain (indicated by an overall completion rate of 47 percent 
compared to 54 percent of the prior -locating problem cases). Although the phone center case management 
group and the field interviewers did about equally well (45 percent vs. 48 percent) when comparing the 
combined results, it is evident that the phone center excelled at completing maximum call cases while the field 
interviewers had better success at completing refusal cases. Furthermore, while the field interviewers had a 
lower cost per completion than originally anticipated (average of 5.9 hours per complete), the phone center 
interviewers did slightly better (average of 5.4 hours per complete). 
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Table 3.7~Field interviewers vs. phone center case-ownership group experiment results 


Case Type 


Mode 


Total 


Complete 


Non-response 


Completion Rate 


Maximum 

Calls 


Phone 

center 


30 


20 


10 


67% 


Field 


30 


19 


11 


63% 


Refusals 


Phone 

center 


30 


7 


23 


23% 


Field 


30 


10 


20 


33% 


Total 


Combined 


120 


56 


64 


47% 


Source: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



3.6 Plans for Main Survey Procedures 

The case management delivery system and the refusal conversion process will be retained as it was 
in the field test. The CATI production will be modified by moving all maximum call cases after the twelfth 
call to phone center maximum call specialists. Cases will be worked in the phone center for a longer period 
of time prior to fielding. 

The intensive phone center locating effort will begin as close to the start of CATI interviewing as 
possible. Locating efforts will primarily concentrate on using parent and contact data supplied by respondents 
during their last interview. The next resource to use will be the respondent's bachelor-granting institution or 
any graduate school he or she may have attended. Prior to the main survey, NORC will send a letter to each 
of the sample institutions’ alumni associations and registrar offices requesting their cooperation in helping 
NORC locate the B&B respondents. A reverse credit bureau check will follow rather than precede usage of 
the postsecondary institution. The state departments of motor vehicles will only be used as a last resort. 

Finally, based on feedback received during the field interviewer debriefing, hard copies of call records 
and locating information will accompany CAPI case assignments. Case materials will also include a hard copy 
checklist which will serve as a guide to help field interviewers determine what has been done with a case and 
what should be done next. Filling out these checklists will encourage interviewers to carefully review the call 
notes and begin a non-duplicatory "plan of attack" for each case assigned, and will familiarize them with use 
of the CMS. 
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4. Field Test Response Rates and Production Quality Control 
4.1 Field Test Response Rates 

The final unweighted response rate for the B&B:93/97 field test was 90 percent. B&B:93/97 
telephone interviewers were able to complete interviews with 81 percent of the field test eligible respondents 
and the field staff completed interviews with another 9 percent of the eligible sample. These percentages are 
based on the total number of cases completed or finalized in the phone center (1 ,302) plus the sample of cases 
worked in the field (250), or a net sample of 1 ,552. 

Table 4. 1 is an analysis of the final dispositions from the B&B:93/97 field test. The "out of scope and 
not fielded” cases are primarily composed of the 292 cases that were not selected during the CATI to CAPI 
transition into the sample of cases to be worked in the field. The remaining six ineligible cases include two 
sample members who have died since 1993 and four members who didn’t graduate within the 1991-1992 
academic year. 

Considering how much respondent locating was necessary, an unbeatable rate of one percent is 
remarkable. The major cause for nonresponse for the B&B: 93/97 field test was sample members' refusals, 
as was the case in the 93/94 field test. However, the 93/97 refusal rate of 5 percent is substantially reduced 
from the 93/94 refusal rate of 8 percent. And the analysis of nonresponse is tempered because the field test 
field period was stopped before all cases were finalized, indicated by the 4 percent response rate attributed to 
that category. 
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Table 4.1~Final sample dispositions: nonresponse analysis 


Final disposition 


N 


Percent of net sample 






(1,552) 


Total 


1,850 


— 


Net sample 


1,552 


100% 


Complete 


1,390 


90% 


Non-response 






Final refusal 


80 


5% 


Final unlocatable 


16 


1% 


Final pending 1 


66 


4% 


Ineligible 






Graduation date out-of-range 2 


4 




Deceased 


2 





Not fielded 


292 


— 


-- Not applicable. 






1 The data collection period ended before field work on all cases was complete. At the time field work ceased, 
interviewers for cases with pending dispositions were still attempting to contact respondents to complete interviews. 


2 These were nonrespondents from the B&B: 93/94 sample who had not graduated within the specified time frame for 
eligibility. Ineligibility due to graduation date will not be an issue in the B&B: 93/97 main survey since NORC has 
obtained transcripts for all the eligible main survey respondents. Any B&B: 93/94 main survey non- respondents who 
were ineligible due to graduation date were already designated as such through the reconciliation process that occurred 
as part of the transcript project. 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 
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Table 4.2 gives a summary of the response rates achieved by gender, race, and by final B&B:93/94 
field test disposition. Response rates by gender are almost equivalent, and response among whites and 
African-Americans is in fact equal. Perhaps most notable is the fact that interviews were completed with 55 
percent, or more than half, of those who had been finalized as refusals in the 93/94 field test. Furthermore, 
NORC was able to locate and interview more than three-fourths (77 percent) of those who were finalized as 
unlocatable last time. For the main survey, cases which were refusals for B&B:93/94 will be sent directly to 
B&B: 93/97 refusal converters. 



Table 4.2-B&B:93/97 field test response rates 




Total 


Complete 


Out of scope or 


Nonresponse 2 


Response rate 








not fielded 1 






Total 


1,850 


1,390 


298 


162 


90% 


Gender 












Male 


706 


539 


101 


66 1 


90% 


Female 


1,085 


823 


181 


81 


91% 


Missing 


59 


28 


16 


15 


65% 


Race 












White 


1,596 


1,225 


246 


125 


91% 


African-American 


108 


79 


21 


8 


91% 


Asian/Pacific Islander 


40 


28 


8 


4 


88% 


American Indian 


5 


4 


0 


1 


80% 


or Alaskan Native 












Other 


17 


13 


1 


3 


81% 


Not reported 


84 


41 


22 


21 


66% 


B&B:93/94 field test 












disposition 












Complete 


1,546 


1,253 


207 


86 


94% 


Refusal 


45 


17 


14 


14 


55% 


Unlocatable 


21 


10 


8 


3 


77% 


Other non-response 


23 8 3 


110 


69 


59 


65 % 


1 These 298 cases include sample members who did not receive their bachelor's degree within the eligible time trame (4), who are 


deceased (2), and those cases that were not sent to the field (292). 






2 The 162 nonresponse cases include 66 which were closed out early because the field period was curtailed. 




3 These were primarily cases which were pending because the 93/94 field test period 


was closed out early to contain costs for the 


main survey. 












SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 
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4.2 Production Quality Control 

To ensure data quality, NORC used the following procedures and reports throughout the data 
collection phase: 



• Interviewers were monitored on a random basis. During each monitoring session, the 
supervisor noted any deviations or errors in interviewing, locating, or gaining cooperation. 
Reports were generated showing overall error rates as well as errors by question number. 
Interviewer feedback sessions were conducted on a weekly basis. During these meetings, 
interviewers received feedback about the group’s performance, and were given the 
opportunity to ask questions or comment on the instrument. 

• Coding accuracy was verified by having a sample of entries from each of the coding 
programs recoded by expert coders. A program then compared the expert coders 
recoded entries with the interviewers original entries and generated a report on error 
rates for coding. 

• Production statistics were produced and reviewed on a daily basis. Efficiency ratios such as 
calls made per completed case, or interviewer hours spent per completed case, were analyzed 
to track, and correct for, trends that affected the efficiency of the data collection effort. 

• Frequencies and time stamps were reviewed daily during the first week of production, and 
on a periodic basis thereafter. Frequencies and time stamps were exported daily and placed 
in the IMS so that they would be available for immediate review had any concerns arisen. 

• A validation process was used to monitor the quality of interviews completed by field 
interviewers. Cases were randomly selected for each interviewer. Respondents were 
recontacted and briefly questioned to ensure that the interviewer actually completed the 
interview and that the interviewer administered the questionnaire appropriately and 
professionally. 

• A reinterview was conducted with 102 respondents using a subsample of the items from the 
original instrument. Results from the reinterview were analyzed to provide information about 
the reliability of selected items. 

Chapter 5 uses the frequency and time stamp information as well as the coding comparisons in its evaluation 
of the instrument items and on-line coding accuracy. Chapter 6 discusses the reinterview results in more 
detail. The remainder of this chapter focuses on the monitoring system and productivity measures. 
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4.2.1 Statistical Quality Control Monitoring 

CATI interviewers were carefully monitored by supervisors to ensure consistent high-quality data 
throughout the field period. NORC’s online monitoring system allowed monitors to simultaneously listen to 
an interviewer, observe the interviewer's computer screen, and record any errors or comments into the 
monitoring system database. Supervisors conducted all monitoring activity from the monitoring room just off 
the interviewing area in order not to disturb the actual interviewer. 

Each day interviewers would be randomly selected for monitoring. Once the monitor connected to 
the interviewer’s computer screen and phone line, the monitoring system would automatically record the start 
time and date of each monitoring session, as well as the ID of the interviewer being monitored and the phone 
number of the active station. The monitor would then identity the activity being observed and record any 
errors that occurred. The major activities were interviewing, locating, and non-interviewing activities such 
as gaining cooperation, and refusal conversion. It was possible, of course, for more than one of these 
activities to occur within a session, and the system logged the amount of time each activity was observed. 
Each activity had a different data capture screen which listed possible problems for which the monitors were 
vigilant. 



The interviewing data capture screen (figure 4.1) allowed the monitor to identify any questions which 
may have been asked, or whose responses were recorded, incorrectly and the type of error that occurred. The 
monitor would enter the question number as displayed on the CATI screen, code the error type, and record 
feedback comments. Entries could be made for multiple questions as well as multiple errors per question. The 
code frame for error type was displayed in a banner across the top of the screen. Cumulative frequencies 
could be produced to identity problematic questions by showing the frequency of each type of error and the 
questions with which they were associated. 
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Figure 4.1 —Interviewing data capture screen 

Interviewing 

List Any Errors Observed 





1 Probing Error 


5 Changed Meaning of Quex 


Interviewing 


2 Clarifying Error 


6 Bias 


Error Codes 


3 Leading Respondent 

4 Miscoding Response 


7 Other 



Ques. No. Error Code Comment (2 lines allowed per Ques. No.) 



The locating data capture screen (figure 4.2) was designed for use with NORC’s Case 
Management System (CMS). All areas of locating expertise were rated on a 5 point scale from " 1 " 
meaning "needs improvement” to ”5” meaning "excellent.” Of course not all facets of locating were 
observed during each monitoring session; therefore, there is a code for "not observed." 

Figure 4.2— Locating data capture screen 



Locating 

Project: 

Score Locator Below 1-5 
( 1 - needs improvement) 

( 5 - excellent) (0 - not observed) 

Probed 

Documented Outcome in Call Notes 
Correct Disposition Assigned 
Resource Used in Correct Sequence 
Understanding of CMS Structure 
Gaining Contact Cooperation 

Comment: 

User ID: Phone: Server: 



Non-interviewing activities such as gaining cooperation and refusal conversion have their own data 
capture screen (Figure 4.3). This screen is less structured than the other screens and relies on comments 
to provide interviewer feedback. 



0 
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Figure 4.3— Non-interviewing activity capture screen 

Non-Interviewing Activities 
Project: 

Code type of Error Observed 
G = Error in Gaining Cooperation 
R = Error in Refusal Conversion 
Error Type 
Comments: 

User ID: Phone: Server: 

Leave Blank if no errors or not applicable 



At the end of each monitoring session, the monitor would rate the overall interviewer performance 
on such qualities as conversational style, explanation of the study, and professionalism on the Session 
Summary Screen (figure 4.4). The monitor could also enter comments that would be useful to help the 
interviewer improve. 



Figure 4.4— Session summary screen 



Session Summary Screen 

Rate the skills listed below 

Scale: 1 = Needs Improvement, 5 = Excellent, 0 = Not observed/NA 



Identification of Self 

Explanation of Study 

Use of Call Notes 

Refusal Conversion/Aversion 

Cadence 

Overall 

Major Activity Observed: (Interviewing, Locating, Non-Ivwg) 



Speed 

Presentation 

Professionalism 

Conversational Style 
Voice Quality 



Comments: 



User ID: 



Phone: 



Server: 
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During the phone center data collection period, supervisors monitored portions of 12 percent of all 
completed CATI interviews. The number of minutes monitored and the number of errors observed were 
reported daily. In addition, the frequency with which items in the CATI instrument had errors reported 
and the monitors’ notes were listed. In all, 282 monitoring sessions were conducted, covering a total of 
3,733 minutes. Monitoring sessions averaged 13.24 minutes, or slightly below our session goal of 15 
minutes. The CATI monitors were able to observe actual interviews during 52.53 percent of the sessions 
for a total of 1 ,506 minutes. The monitors noted 1 1 interviewing errors, yielding an error rate of .0073 
errors per minute. 



4.2.2 Productivity Measures 



NORC obtained productivity measures by analyzing statistics collected in the Telephone Number 
Management System (TNMS). The dispositions of all calls made in the telephone shop were tracked along 
with the time required for each transaction. This information was used to generate statistics on the number 
of cases completed and the effort required to complete interviews. Interviewing production reports were 
generated nightly and automatically updated in the IMS. An example of the daily interviewing production 
report is shown below (figure 4.6): 

Figure 4.5-Daily production interviewing. 





Completes 


Hours 


Calls 


Calls 


Calls 


Number 


Interviewer 


Number 


Average 




per day 


per 


per 


per 


per 


of 


Hours 


Cases 


Administration 






Complete 


Hour 


Day 


Complete 


Interviewers 




Touched 


Time 


06/27/96 


15 


4.45 


4.15 


277 


18.47 


16 


66.79 


163 


38.58 


06/26/96 


21 


3.73 


4.21 


330 


15.71 


18 


78.34 


139 


33.36 


06/25/96 


25 


2.77 


4.88 


338 


13.52 


16 


69.23 


165 


35.88 


06/24/96 


19 


3.12 


4.72 


280 


14.74 


14 


59.34 


184 


40.02 


06/23/96 


20 


1.53 


5.63 


172 


8.60 


7 


30.54 


134 


37.53 


06/22/96 


23 


1.79 


5.50 


226 


9.83 


7 


41.11 


179 


30.63 


06/21/96 


12 


3.48 


4.50 


188 


15.67 


9 


41.75 


188 


39.84 


06/20/96 


17 


3.81 


4.94 


320 


18.82 


16 


64.79 


192 


38.88 


06/19/96 


28 


2.80 


3.76 


295 


10.54 


21 


78.39 


206 


36.60 



By analyzing the daily productivity measures, such as number of completed interviews, hours 
per complete, calls per complete, and the number of cases touched, the B&B:93/97 management team was 
able to gauge the effectiveness of the staffing plan and make quick adjustments as warranted. 
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5. Instrument Evaluation 

5.1 Length of the Interview 

Respondents were typically on the telephone for 39 minutes with phone center interviewers. 
The average administration time for the actual survey instrument was a few minutes less, just over 36 
minutes. Table 5.1 presents information on the average administration time for the complete survey 
instrument, as well as timings for subgroups. 



Table 5.1—Average length of interview, in minutes, for all respondents and subgroups 




Number of 


Average length 




respondents in 
subgroup 


of interview 


All respondents 


1,377 


36.7 


Respondents who applied to graduate school since last interview 


341 


42.6 


Respondents who enrolled in school since last interview 


666 


41.8 


Respondents who taught school since last interview 


275 


45.0 


Respondents who searched for new job as result of graduate of 
professional degree 


145 


43.6 


Respondents who were employed 


1,208 


36.6 


Respondents who attended training sponsored by employer 


468 


36.7 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 


1996 





It is apparent that the interview was quite long, approximately three-quarters of an hour, for 
those who had either taught school or had attended school since the last interview. During our interviewer 
debriefings, interviewers reported that interviews with these groups were difficult, yet they also stated that 
respondents who were in school or teaching school seemed to appreciate the purpose of the study and were 
willing to complete the interview. 

Table 5.2 presents more detailed information concerning the length of each major section of the 
interview. Average administration times are reported for two groups, all respondents and the subgroup of 
respondents who answered items in that section. 
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Table 5.2--Average interview administration times in minutes by section 






Number of 


Average for 






respondents 


those answering 




Average for 


answering items 


items in each 




all interviews 


in each section 


section 


Total 


36.70 


1,377 


- 


Graduate exams section 


.36 


1,377 


.36 


Graduate applications section 


.85 


341 


2.68 


Enrollment section 


4.89 


666 


7.71 


Teaching section 


3.20 


275 


10.80 


Job search section 


1.65 


145 


2.06 


Employment section 


7.65 


1,289 


7.69 


Employment history 


2.33 






April job 


5.40 






Training section 


1.71 


468 


2.66 


Demographics and other items 


11.24 


1,377 


11.24 


section 








Advice/skills 


2.07 






Undergraduate education 


1.07 






Volunteer/political participation 


1.68 






Demographics 


2.30 






Income and savings 


1.76 






Education debt 


1.07 






Other debt 


1.13 






Locating information section 


5.55 


1,377 


5.55 


-Not applicable. 








SOURCE: NCES, Baccalaureate and Beyond: 93/97 Field Test, 1996 





The longest single section was the demographic section, which included items on race, 
household members, income, savings habits, educational and other debt, as well as items concerning skills 
from undergraduate school, advice to students entering college, voting behavior, volunteer work, and 
computer ownership. Ot these subareas of the demographic section, only a few took more than one 
minute: a series of questions on volunteer work (101 seconds); a series about skills learned in college and 
used in employment (79 seconds); income questions (75 seconds); and educational debt (64 seconds). 

The teaching section also took a long time to administer, just over ten minutes among those 
respondents who had actually taught school since the last interview. The employment and education 
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sections each took over seven minutes. Nearly all respondents completed the employment section, while 
only about half of all respondents completed the education section. 



5.2 Item Nonresponse 

Once respondents agreed to be interviewed, they were very cooperative in answering questions. 
Very few items have any “don’t know” or “refused” responses. In fact, only twenty-three items have 
greater than five percent missing data. These items and the number of “don’t know” and “refused” 
responses for each are presented in table 5.3. 

Income. Almost all of the items with high levels of missing data involve dollar amounts (20 out 
of the 23 items). The item with the most “don’t know" and “refused” responses concerns the income of 
non-spouse household members. Of the 180 respondents asked to report on the income of non-spouse 
household members, only 50 percent responded. About 17 percent of married respondents were unable or 
unwilling to give precise information about their spouse’s earnings and income. Fortunately, over 90 
percent of respondents did provide information on their own total income, earnings, and salary earned at 
the job held in April, 1996. 

Tuition and financial assistance. About twelve percent of respondents who received aid were 
unable to give estimates of the amount of financial aid they received. Similarly, about 12 percent of 
students who had enrolled in school since the last interview were able to answer an item about the amount 
of tuition they paid. 

Debt. While most married respondents knew whether or not their spouse had any educational 
debts, 25 percent of the respondents who said their spouses did owe money were unable to report how 
much had been borrowed or was still owed. Respondents had an easier time providing information about 
their own educational debts. Of the series of items concerning respondents’ own borrowing for education, 
one item had a noticeable level of missing data: five percent of respondents who had borrowed money for 
undergraduate school couldn’t estimate the total amount of undergraduate debt that they still owed to 
nonfamily sources. 

While almost all respondents could provide information about monthly housing and car 
payments, a small number refused to answer an item concerning the amount of monthly payments for all 
other debt. Sue percent of the respondents who reported that they had other debt refused, or didn’t know, 
the amount of the monthly payment. 
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Table 5.3— Items with more than 5 percent don’t know and refused 


Item 




Asked 


Refused 


Don't 

Know 


Total 

Missing 


PAIDAM 


Amount of financial assistance received-first enrollment 


217 


4 


21 


11.5% 


PBTUIT 


Tuition prior to discounts or waivers— first enrollment 


411 


3 


46 


11.9% 


PAIDAM2 


Amount of financial assistance received— second 
enrollment 


24 


1 


2 


12.5% 


PBTUIT2 


Tuition prior to discounts or waivers— second 
enrollment 


45 


1 


4 


11.1% 


CERT 1 STM 


Month R first certified to teach 


60 


0 


4 


6.7% 


CERTMM 


Month highest certification issued 


98 


0 


9 


9.2% 


AJOBSAL 


Salary in April 1996 


1319 


68 


17 


6.4% 


AJBSTSAL 


Salary when first began April job 


1319 


61 


17 


5.9% 


AJBFAM 


Does April job provide familv-related benefits 


1317 


2 


65 


5.1% 


TOTINCOM 


R's income from all sources - continuous 


1366 


86 


45 


9.6% 


TOTINCM 


R's income all sources - combined continuous and 
categorized 


1366 


86 


5 


6.7% 


ANNUINC 


R's income from all jobs - continuous 


1366 


84 


43 


9.3% 


ANNUINCR 


R's income all jobs - combined continuous and 
categorized 


1366 


84 


5 


6.5% 


TOTINCSP 


Spouse’s income from all sources - continuous 


749 


75 


56 


17.5% 


TOTINCS 


Spouse’s income all sources-combined 
continuous/categor ized 


749 


75 


21 


12.8% 


ANNINCSP 


Spouse's income from all jobs - continuous 


749 


77 


48 


16.7% 


ANNINCS 


Spouse's income all jobs-combined continuous and 
categorized 


749 


77 


20 


13.0% 


HSEDIN 


Other HH members income from all sources - 
continuous 


123 


13 


50 


51.2% 


HSAANINC 


Other HH members income from all sources - 
combined 


123 


13 


20 


26.8% 


OWENFAM 


Amount of undergrad debt still owed to non-family 
sources 


824 


4 


38 


5.1% 


TOTLOANS 


Total amount of spouse's educational debt 


268 


5 


70 


28.0% 


TOTALBAL 


Amount spouse still owes for educational debt 


268 


6 


60 


24.6% 


OTHDEBP 


Monthly payments for all other debt 


700 


30 


16 


6.6% 


SOURCE; NCES. Baccalaureate and BevontL 93/97 Field Test. 1996 
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Month received teacher certification. Almost all teachers could report the year they had first 
been certified, as well as the year they received their highest level of certification. However, between 7 
and 10 percent of certified teachers could not provide the corresponding months they had received the 
certification. 

Family leave benefits. About 5 percent of respondents did not know whether or not the job 
they held in April, 1996, provided family-related benefits such as maternity leave. These same 
respondents were able to answer questions about other benefits such as health insurance, sick leave, and 
paid holidays. 

5.3 Evaluation of On-line Coding Accuracy 

The field test instrument made use of five coding programs developed by NCES. These 
programs were used to code postsecondary institutions, elementary and secondary schools, major field of 
study, industry and occupation. The coding programs for industry, occupation, and major required 
interviewers to enter the brief “verbatim" text supplied by the respondent. The coding program then 
suggested several possible codes and the interviewer was to select the most appropriate code. 

To judge the quality of the coding being done by the interviewers, NORC periodically exported 
information from the major field of study, industry and occupation coding programs and gave it to 
specially trained coders. The coders were asked to use the verbatim text entered by the interviewer and 
select an appropriate code. If the code selected disagreed from that originally chosen by the interviewer, 
the coder was shown the interviewer-selected code and was asked to judge if that code was reasonable or 
not. The results of this verification process are displayed in table 5.4. 

Interviewers did a fairly good job in using the coding programs and the differences in coding 
accuracy between the programs is relatively small. The reasons for the relatively large number of 
“reasonable but different” codes for occupation and major is probably due to the length and complexity of 
these codes. The industry coding program is relatively short and codes can more easily be judged correct 
or incorrect. 



'While this export will occur weekly in the main survey, due to the much lower number of cases in the field 
test, it was not cost-effective to export the verbatims and codes on as frequent a schedule. 
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To examine the accuracy of school coding, coders were given the text entered by interviewers 
when the school named by the respondent could not be found. In these cases, coders were asked to judge 
the completeness of the information entered by the interviewer: was the name, city and state information 
sufficiently complete so that it can be coded later? Again, interviewers were typically very good in 
recording this information: over 90 percent of such responses had sufficient information to allow a later 
determination of the correct code. 



Table 5,4~Reliability of interviewer coding using on-line coding programs 


Coding program 


Percent of cases 
where sufficient text 
was entered to allow 
verification 


Verified cases 


Percent coder 
and interviewer 
agreement 


Percent coder and interviewer 
disagreement: 


Interviewer code 
reasonable 


Interviewer code 
incorrect 


Major 


98.1% 


79.7% 


15.7% 


4.6% 


Industry 


95.6% 


82.4% 


9.9% 


7.6% 


Occupation 


97.3% 


74.9% 


18.7% 


6.4% 


Postsecondary 

institution 


95.1% 


- 


- 


- 


-- Not applicable. 

* Names of institutions were entered only when the interviewer was unable to find a code in the list 
provided. Here, the coders were asked to judge the completeness of the information entered about 
the school: name, city, state. 

SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



5.4 Evaluation of Coding Frames 

To assess the completeness of the coding frames used, all items with lengthy code lists included an 
“other, specify” category for the field test. Table 5.5 presents information on the items with coding 
frames that need expansion or clarification. 
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Table 5.5-Examples of responses to "other, specify" items 


Item 


Abbreviated item text 


Potential additional codes 


AJOBT14 


How did you find out about this job? 


Started own business; created own job 

Through college/grad school employee 
program 


AJOBTYPE 


Would you say this job is executive, 
managerial , professional . . . 


Some of everything 


AJOBWHY 


Why did you accept this position 
with < EMPLOYER NAME> 


Convenience (hours/location/child care) 
Related to field of study 


LEFTTEACH 


What is the primary reason you 
decided not to pursue teaching? 


Needs certification/lacks educational 
background 

Not my career goal 


NEVAPP 


What are the reasons you did not 
apply for a teaching position? 


Pregnancy/ or have children to take care of 


NONTCHJB 


Have you had any non-teaching but 
education-related jobs? 


Tutor 

Teacher (of non-school related subjects) 


SAVING 


What have you been saving money 
toward?.... 


Saving, just because 
Vacation, travel 
Car 

Engagement ring/marriage 
For a rainy day or emergency 
Repairs for home/items for home 
Future 

Pay off loans or debt 
Family or children 
Moving 


VOLWKDO 


What types of volunteer work did 
you do? 


Church/religious 
School-related volunteer (e.g., 
served on school board) 
Community work 
Red Cross 

Medical org (Am Lung Assn) 
AIDS service organization 


WHNA1D 


Why didn’t you apply for aid? 


Employer paying tuition/ tuition 
reimbursement 


SOURCE: NCES, Baccalaureate and Beyond: 93/97 Field Test, 1996 
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It is clear that in many of these instances, the addition of a new code will solve the problem. For others, 
most notably the item which asks about volunteer work, it appears that the conceptual framework used to 
construct the original frame does not correspond to the way respondents interpret the question. 

5.5 Interviewer Debriefing Suggestions 

Interviewers thought the instrument was greatly improved from the First Followup. However, there 
was universal agreement that streamlining steps were needed for the post-baccalaureate enrollment and 
employment history sections. Although interviews with respondents who were teachers or who were 
currently enrolled in school took longer, both of these respondent types seemed to appreciate the purposes 
of the study and were willing to complete the interview. Interviewers especially commended the inclusion 
of the open-ended question which asked respondents to give advice to people starting college; its placement 
allowed for a “breather” from the interview. In addition, respondents very much enjoyed being asked their 
opinion and being allowed to give a ffee-form response. 
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6. Field Test Reinterview 

The purpose of the reinterview was to assess the reliability of selected items in the B&B:93/97 field 
test instrument. To ease respondent burden, a subsample of 100 respondents was targeted for participation 
in a five-minute reinterview. Four series of items were included in the reinterview. Because the number 
of items which could be asked these respondents was limited, NORC decided to focus on those suspected 
of being unreliable. The items, and the reasons for their inclusion in the reinterview, are described below. 
A complete list of the items is included in Appendix F. 

Graduate applications. Graduate school application items had been reworded to ask for the two 
most recent schools applied to, rather than “first” and “second” choice schools as it was asked in 93/94. 
These items were included to help ascertain the reliability of this change in question phrasing as there was 
concern over the possibly ambiguity of “two most recent,” especially for those respondents who may have 
applied to graduate schools en masse. 

Teaching. Since the teaching section was greatly redesigned for the second followup field test, 
select items from this section were incorporated in the reinterview. Respondents were asked about their 
teaching jobs and dates of employment, and then selected their primary teaching job for each academic 
year. Items about participation in-service or professional development programs were also included, as 
were items about changes in the respondent’s teaching practices as a result of these programs. This series 
of questions about professional development programs was thought perhaps to be too subjective and 
ambiguous to be answered reliably. 

Skills. Among the new items in the second follow-up field test was a series of items asking for the 
respondent’s assessment of the importance of certain skills in their job, and their improvement by 
undergraduate education. These were included in the reinterview to determine if this is a meaningful 
question and whether respondents can really answer it. 

Education debt. This section was changed somewhat since the last survey, and works off of 
preloaded B&B:93/94 data. Instead of asking about each individual loan, items now ask the respondent for 
the total amount of debt accrued for undergraduate and graduate education, and how much debt remains. 
The accuracy of these responses were tested in the reinterview, and feedback from the reinterview 
respondent helped determine if these questions are difficult to answer. 

6.1 Field Test Reinterview Production 

The sample. A special sample of cases was selected in order to optimize the reinterview data. 

Cases were selected which met both of the following conditions: 

• attended post-baccalaureate school and answered either the question on status in professional 
program or status in graduate program (currently or when stopped attending); 

• had a teaching job and answered the question about whether or not participation in certain 
programs changed their teaching practices. 
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From 1 ,226 cases completed in the telephone center, 368 met these criteria. Of these, 300 were randomly 
sampled to be included in the reinterview. The goal was to complete 100 interviews. The decision to use 
a large sample was made to reduce the cost of the reinterview and complete the reinterviews quickly. 

Table 6. 1 presents the final dispositions of all cases. 



Table 6.1— Reinterview disposition of cases 


Category 


Total 


Completes 


102 


Refusals 


4 


Moved/temporarily unlocatable 


23 


Respondent to call 


9 


* 

Other worked cases 


162 


TOTAL 


300 


* 

These are cases that had been worked but not finalized by the time production ceased (e.g., 
no answers, busy, answering machines, soft appointments). 


SOURCE: NCES, Baccalaureate and Beyond: 93/97 Field Test, 1996 





Four interviewers were trained to conduct the reinterview. Interviewers were instructed not to make 
appointments for more than seven days in the future. This policy was initiated because of the expected 
short duration of the reinterview period. After completing a reinterview, the interviewer asked the 
respondent a few additional items to obtain respondent reactions to the instrument and the reinterview 
process. 

Reinterviewing began on August 13 and ended on August 21, 1996. Based on the original 
interviewing production, reinterviews were conducted only in the most productive times of Tuesday, 
Wednesday, and Thursday evenings. After five days of reinterviewing and approximately 37 interviewer 
hours, 102 interviews were completed. The final production statistics are summarized in table 6.2. 



60 



Chapter 6 - Page 50 



Baccalaureate and Beyond 
Field Test_ Report, 1996 



Table 6.2-Reinterview production statistics 


Completed 


102 


Minimum number of calls to complete interview 


1 


Maximum number of calls to complete interview 


5 


Average number of calls to complete interview 


1.4 


Average minutes to complete a given interview 


5.7 



6.2 Analysis of Reinterview Data 

Reinterview data poses a challenge to the analyst. The easiest method, direct comparison of variable 
values across interviews, does not paint a complete picture. Often, data across interviews do not agree 
because of inconsistencies in previous items and altered skip patterns within the interview. 

The goal in conducting this reinterview was to examine the reliability of respondent reports, as 
captured by interviewers, in the two surveys. Thus, the analysis focused on the level of agreement 
between exact items among people who responded to the items in both surveys. This measure provides an 
assessment of the quality of a single item. However, the analysis reported here should be interpreted 
cautiously. For some items, the actual percentage of disagreement between similar variables in the two 
data files may be larger because they items were embedded in larger “skip patterns.” 

In the tables that follow, reliability is discussed in terms of the proportion of cases that had data 
which disagreed between the two interviews. Levels of disagreement in excess of 20 percent are cause for 
concern. 

6.3 Analysis of Graduate School Application Items 

The graduate school application section was changed considerably from the B&B:93/94 survey, and 
these items were included in the reinterview to assess reliability of the new item wordings. Instead of 
asking for the first and second choice schools to which the respondent applied, the B&B:93/97 field test 
survey asked about the “most recent” and “next most recent” schools. In addition, respondents were asked 
for the date of their most recent applications. 

This section was further complicated by the fact that questions had to be tailored to B&B:93/94 
respondents depending on whether or not they had applied last time, as well as nonrespondents who were 
also asked about the date they first applied to any graduate schools. 

Table 6.3 gives general results on the reliability of respondent reports about applications to graduate 
school. For each item, the percent of respondents who supplied answers to both interviews are reported in 
the second column. The third column presents information on the number of cases where the information 
captured in the two interviews is in disagreement. 
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Table 6.3~Reliability of reports of graduate school applications 




Responses to item 


Response discrepancies 


Item 


(percent of 102) 


(percent of responses) 


Whether or not respondent applied to graduate 


102 


14 


school 


100.0% 


13.7% 


Number of graduate school applications 


41 


6 




40.2% 


14.6% 


Month of most recent application to graduate 


44 


33 


school 


43.1% 


75.0% 


Year of most recent application to graduate 


44 


12 


school 


43.1% 


27.3% 


“Most recent” graduate school applied to 


44 


3 




43.1% 


6.8% 


“Next most recent” graduate school applied to 


21 


7 




20.6% 


33.3% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 



Graduate school applications. Eighty-eight respondents--86 percent of 102 complete reinterview 
cases— gave the same response when asked whether or not they had applied to graduate school since their 
last interview date (or bachelor’s degree receipt date, in the case of B&B:93/94 nonrespondents). Nine 
people who had originally answered “Yes” to this question answered “No” in the reinterview. Further 
analysis showed that one of these discrepancies was due to interviewer error in the first interview. Five 
respondents who originally reported that they had not applied gave the opposite answer in the reinterview. 
Two of these discrepancies could be explained upon further investigation; one respondent had actually 
applied between the original interview and reinterview dates, and the other reported that the most recent 
application date was sometime in 1993, but did not know the exact month. 

Of the 41 respondents who had indicated that they had applied to graduate schools, only six, or 15 
percent, differed in the number of school applications they reported when comparing their reinterview 
response to their initial response. This is partially due to the fact that the majority of respondents applied 
to two or fewer schools, but even those who applied to a larger number reported the same number each 
time. In the six discrepant cases, three people reported one additional school application while the other 
three people reported one less school application than they had initially. 

Most recent date applied to graduate school. Table 6.3 indicates a high percent discrepancy for 
both the month (75 percent discrepancy) and year (27 percent) respondents reported applying to graduate 
school. However, closer inspection showed that 19 of the discrepant cases were only one month apart, 
three dates were apart by two or three months, and seven dates were apart by four to six months. Five 
respondents (11 percent) reported conflicting application dates that were more than a year apart. 
Therefore, only 34. 1 percent, or about one third of the cases, differed by more than a month on their 
reported date of most recent application. Figure 6.1 shows the degree of discrepancy, by number of 
months, between the two respondent reports. 

O 
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Reliability of graduate school reports. When asked for the names of the two most recent schools 
to which they applied, respondents were able to answer reliably. Only three respondents reported a 
different school for the most recent application. Reports of the next most recent school are also reliable, 
taking into account that six of the seven discrepant cases were due to a difference in the number of 
graduate school applications (for example, respondents reporting that they had applied to two schools in the 
first interview but changing their answer to one in the reinterview). 

6.4 Analysis of Teaching Job Items 

The teaching section of the B&B second followup field test questionnaire represented a radical 
departure from the first follow-up. In the first followup, the emphasis was on describing the 
characteristics of newly qualified teachers; in this followup, emphasis was placed on tracking movement 
into and out of teaching. For example, the move into teaching is often characterized by additional 
schooling for licensure, and gaining experience as a substitute or part-time teacher. Moreover, a higher 
percentage of respondents would have gained more teaching experience in this round, and additional items 
were needed to assess the quality and types of those experiences. 
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Figure 6.1 —Difference of application dates by number of months (N=44) 




SOURCE: NCES, Baccalaureate and Beyond Second Follow-up Field Test, 1996 



In the B&B:93/97 field test, teachers were asked about their employment history: whether they had 
substitute teaching or teacher’s aide positions, and the names and dates of employment for the schools at 
which they had "regular” teaching jobs. In addition to obtaining general employment spell information, 
questionnaire items also collected data on such elements as class size, fields taught, and number of school 
periods each field was taught, for each academic year the teacher was employed. Respondents had to 
choose their primary job in cases where more than one regular teaching job was held in a particular 
academic year. The reinterview items in the teaching section were chosen to ascertain the reliability of 
this teaching employment history, as well as the respondent’s report of their primary jobs in each academic 
year. 



Table 6.4 shows the general results for respondent reports of teaching jobs. When reinterviewed, 
six respondents reported that they had never worked as an elementary or secondary school teacher. 
Investigation of the original data showed that although four of respondents had answered “yes” to this 
question, they had held only substitute or teacher’s aide positions, and never held regular teaching jobs. It 
is possible that these reinterview respondents screened themselves out of the subsequent question, “How 
many regular teaching positions have you held?” based on the original interview experience. 

Number of teaching jobs. Analysis of subsequent reinterview items points to the need for clearer 
instructions and guidance for both the respondent and interviewer in the main study. Half of the six 
discrepant reports for the number of regular teaching jobs was due to unclear situations which resulted in 
inconsistent reporting of jobs: one teacher who worked at two different schools on the same campus named 
both schools in the original interview and only one in the reinterview; and two teachers named the same 
school twice, once for each academic year employed. The three remaining discrepant cases were due to 
the omission of one teaching job either in the original data or the reinterview. 

Employer names. Inconsistent reporting of number of jobs is obviously also a factor in the percent 
discrepancy of employer names. Although the sample size is too small to identify a pattern, it seemed as 
likely for respondents to recall an earlier job in the reinterview as it was for them to forget a job. Of the 
seven discrepant first employer names, three were due to differences in number of jobs reported. The 
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remaining four discrepant cases comprised completely different employer names with exact matching 
employment dates. 

Dates of employment. As table 6.5 shows, respondents generally provided reliable reports of their 
employment dates. Teachers were more likely to err in their responses for job start dates; although 
roughly 19 percent of the discrepancies were due to a one to three month difference, 14.3 percent of these 
dates differed by a year or more. The percent discrepancy drops considerably for respondent reports of 
job ending dates, primarily due to the fact that the majority (38 teachers, or 90.5 percent) were still 
employed at that job. 

Participation in in-service or professional development programs. Teachers were asked about 
their participation in programs on: 

• uses of educational technology for instruction; 

• methods of teaching a subject field; 

• in-depth study of a subject field; 

• student assessment; and 

• cooperative learning in the classroom. 

Respondents were then asked about the impact of these programs on changing their teaching 
practices. These items were included in the reinterview to assess the reliability of responses and the 
teacher’s subjective measure of a change in teaching practices. Although the relative number of 
reinterview respondents who answered this question was small (27 out of 102), these items did exhibit a 
high degree of unreliability as evidenced by differences of about 30 percent for each of these items. 
Teachers seem unable to accurately report their participation in training or development programs, and to 
assess changes in their teaching practices as a result. 
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Table 6.4-Results for teaching employment history 




Responses to item 


Response discrepancies 


Item 


(percent of 102) 


(percent of responses) 


Whether or not respondent ever worked as 


102 


6 


elementary or secondary school teacher 


100.0% 


5.9% 


Number of regular teaching jobs 


49 


6 




48.0% 


12.2% 


Name of first school/employer 


49 


7 




48.0% 


14.3% 


Starting month of first teaching job, 


42 


9 


where job names match 


41.2% 


21.4% 


Starting year of first teaching job, 


42 


6 


where job names match 


41.2% 


14.3% 


Ending month of first teaching job, 


42 


3 


where job names match 


41.2% 


7.1% 


Ending year of first teaching job, 


42 


1 


where job names match 


41.2% 


2.4% 


Name of second school/employer 


8 


2 




7.8% 


25.0% 


Starting month of second teaching job, 


8 


1 


where job names match 


7.8% 


12.5% 


Starting year of second teaching job, 


8 


0 


where job names match 


7.8% 


0.0% 


Ending month of second teaching job, 


8 


2 


where job names match 


7.8% 


25.0% 


Ending year of second teaching job, 


8 


1 


where job names match 


7.8% 


12.5% 


NOTE: Not included in this table is one respondent who had four teaching jobs. The data for all job names and 


dates matched. 






SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 
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Table 6.5— Degree discrepancy of employment dates for first teaching job 


Number of months discrepant 


Number of cases 


Percent of cases 
(out of 42) 


Job start date: 






None 


28 


66.7% 


One 


6 


14.3% 


Two to three 


2 


4.8% 


Twelve or more 


6 


14.3% 


Job end date: 






None/still employed 


39 


92.9% 


One 


2 


4.8% 


Twelve or more 


1 


2.3% 


NOTE: Due to rounding, details may not add to 100 percent. 
SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996. 



6.5 Analysis of Skill Improvement and Importance Items 

The B&B:93/97 field test incorporated a new series of questions involving the importance of various 
skills and abilities in the respondent’s job, and whether the respondent’s undergraduate education improved 
those skills. Table 6.6 indicates that respondent reports on these items were not completely reliable, with 
discrepancy rates among the 102 respondents ranging from two to 30 percent. 

Respondents had more difficulty determining whether the skill was improved by their education than 
whether it was important in their jobs, which is understandable since four years have passed since their 
graduation. Furthermore, discrepancies in items on undergraduate improvement were more often seen 
among those who said the skill was not important in their job. 

The items which had the highest discrepancy levels were those that dealt with psychosocial skills, 
such as self-understanding (30 percent) and the ability to influence others (23 percent). However, even the 
more concrete abilities such as mathematical and computer skills elicited divergent responses in the two 
interviews. Furthermore, analysis of the data for questions that had significandy lower discrepancy levels 
showed that the majority of respondents were giving the same answer. Ninety-six percent of the 
respondents whose responses were not discrepant answered that the ability to influence others is important 
in their job, while 100 percent answered that speaking skills were important, and 98 percent answered that 
writing skills were improved by undergraduate education. Based on these results, it is recommended that 
this series of items be eliminated from the main study. 
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Table 6.6~Reliability of reports for skill items 




Item 


Response discrepancies (percent of 102) 

Improved by undergraduate 


Important in job? 


education? 


Mathematical skills 


23 


20 




22.5% 


19.6% 


Ability to influence others 


11 


23 




10.8% 


22.5% 


Computer skills 


15 


20 




14.7% 


19.6% 


Speaking skills 


2 


17 




2.0% 


16.7% 


Writing skills 


13 


8 




12.7% 


7.8% 


Self-understanding 


16 


31 




15.7% 


30.4% 


Understanding scientific theory or 


19 


13 


method 


18.6% 


12.7% 


SOURCE: NCES, Baccalaureate and Beyond:93/97 Field Test, 1996 





6.6 Analysis of Education Loan Reporting Reliability 

One of the goals of B&B:93/97 is to understand how education debt affects graduates’ choices 
concerning career and further schooling. The second followup field test questionnaire contains a series of 
items about education loans from family and non-family sources, and debt repayment. New items included 
in this round gather data on education loans for graduate or professional education. The reinterview 
consisted of items concerning dollar amounts borrowed for graduate education and owed for all 
(undergraduate, graduate, or both) education debt. 

Results of the reinterview confirm findings in the first followup field test regarding respondent 
reports of dollar amounts borrowed and owed. One third of those respondents who were ever enrolled in 
graduate or professional programs gave inconsistent amounts for their graduate education debt. Almost 
two-thirds of those respondents with any education debt (for undergraduate and/or graduate education) 
gave inconsistent figures for the amount they still owed. 

The analysis of these items should be interpreted with caution, as it is possible that the amount 
borrowed for graduate education could have increased or the amount of outstanding debt could have 
decreased in the time period between the original interview and the reinterview. 
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Figures 6.2 and 6.3 provide a more detailed breakdown of the differences in respondent reports of 
graduate loan amounts and total outstanding debt, respectively. In the case of graduate education loans, 
figure 6.2 shows a negative discrepancy if the dollar amount reported in the reinterview is greater than that 
given in the first interview, and a positive discrepancy if the reinterview amount is less than the original. 
While the latter case is highly unlikely, it is possible that respondents borrowed more money for their 
graduate education in the time between the two interviews. The same argument applies to figure 6.3, 
which shows a negative discrepancy if the total amount owed in the reinterview is greater than in the 
original, and a positive figure if the opposite condition is true. Further analysis showed that the average 
monthly debt payment for respondents is about 200 dollars. In this case, it is quite probable that the 
respondent had made payments toward the outstanding debt and actually decreased it (at least in the case of 
small differences) during the intervening period between the two interviews. 



m 
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Figure 6.2--Differences in amount borrowed for graduate education (N=68) 




Figure 6.3— Differences in amount of total outstanding education debt 
(both undergraduate and graduate debt) (N=65) 
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APPENDIX A 
Case Management System 



Appendix A: Case Management System 



NORC’s Case Management System (CMS) is a new computer-assisted management and 
locating system. In a mixed-mode study such as B&B: 93/97, which involves both CATI and CAPI 
questionnaire administration, and whose sample requires an intensive locating effort, the CMS serves 
several purposes. During the CATI production period, CMS is used to provide project staff with 
detailed data about each sample case and its current status as well as to guide and track all locating 
activities. In addition to these two functions, during the CAPI production period, the CMS is also used 
to enter and transmit all case and cost data from field interviewers and managers and to allow 
interviewers instant access into the CAI instrument. Finally, throughout the entire survey period, the 
CMS database can produce standard cost, production, and case status reports; moreover, it allows users 
to generate ad hoc reports through query language or more complex, project-specific reports through 
programming. 

CATI production period. The Telephone Number Management System (TNMS) managed the 
sample during the telephone data collection period, and each night NORC used an overnight process to 
transfer information about the results of all attempted contacts, and current status of each case, from 
the TNMS to the CMS. (The CMS retained a cumulative history of all attempted case contacts 
throughout the entire survey period, thus allowing an analysis, or review, of all contacts attempted with 
each respondent, whether by locators, CATI interviewers, or CAPI interviewers.) Furthermore, 
whenever a respondent’s telephone number was identified as being incorrect in the TNMS, the 
overnight process would flag this case in the CMS as one requiring the attention of a locator. (The first 
time this flag appeared, the case was sent to a credit bureau service to obtain updated information; 
subsequent occurrences were sent directly to a locating specialist). When a case was identified as one 
requiring locating, it was assigned to a locating team, and all information associated with the case was 
made available to that particular locating team via the CMS; at the same time, that case was no longer 
available in the TNMS to be sent to a CATI interviewer. 

Locators used the CMS to inform, guide, and track their locating activities. Information 
available to the locators on the CMS included: 

• all of the locating information that was gathered from the B&B sample members during 
previous interviews (i.e. parent and contact names, addresses, and phone numbers, as 
well as the respondent’s name(s), address(es), phone number(s), social security 
number, driver’s license number and issuing state, baccalaureate-granting institution, 
and, if relevant, graduate school attended); 

• a record, and results, of all previous attempts at locating or contacting the respondent 
during the current interview period (since the CMS contained both TNMS and CMS 
call record results and comments) as well as any updated address and phone numbers 
obtained 

The call records are also where the locators recorded the results, and dates, of all of their own 
locating activities. The screen would automatically fill selected fields with the respondent information 
related to the case they were working and the date and time, and it would also identify the contact type 
as originating in the locating center. It would then require the locators to indicate the resource they 
were using (e.g. parent, contact, Transunion, alumni association, military locating service, graduate 
school, department of motor vehicles). These resources were displayed in the order in which they were 




to be used, and consequently they guided the locators as they identified the next appropriate step to take 
in the locating process if the current resource usage had proven unsuccessful. 

Next, locators were prompted to indicate an outcome code for the resource usage (e.g. no 
answer; refusal by contact; informant to call; locating resource gave new lead; locating resource in 
process-for inquiries that involved submitting inquiries that required waiting for responses from the 
contacted institutions; respondent found-send to CATI; locating problem— indicating this particular 
resource was a dead-end and the next locating resource should be used). The locators were then to 
enter into a comments box a more complete description of the nature of their usage and result. 

When the outcome code for “respondent found-send to CATI” was entered, the overnight batch 
process would make this case again available in the TNMS to CATI interviewers and, subsequently, it 
would no longer appear on the locators’ CMS screens. Following is a brief description of the four 
CMS screens, and their functions, which locators used in the B&B: 93/97 field test. 



• Listing View 



Calls 



Person/Address 



Appointments 



listed identification numbers, respondent names, last case dispositions, 
and date on which that disposition was set, of all cases assigned to the 
locating team enabling team members to find and sort cases by age, 
disposition, or both in order to identify the next appropriate case to 
work or next appropriate locating step to take for a particular case 

listed the types and results of all attempted interviewing and locating 
contacts for a case to identify a locator’s next appropriate activities for 
that case; recorded all the locating activities the locator engaged in for 
that case as well as tracked its current status for management 

listed all addresses and phone numbers associated with the respondent, 
the respondent’s parents, and the respondent’s contacts; recorded all 
new contacts, or updated addresses and phone numbers, acquired 
through the locating process 

listed and recorded all appointments and call-backs set with either 
informants or respondents; allowed appropriate scheduling of daily 
locating activities 



CAPI production period. At the end of the CATI production period, NORC loaded into 
laptop computers the information contained in the CMS for all of the remaining cases that were to be 
fielded. These computers contained a version of the CMS which not only allowed access to the screens 
the locators used, described above, but also allowed access to the Cost Records Screen, which in turn 
allowed daily entry of cost data, and to the Transferable Cases Available screen, which allowed the 
transfer or receipt of selected cases. Both of these screens are options within the CMS. This version 
of the CMS was also linked to the questionnaire, allowing interviewers immediate access to the 
interview instrument. 



The district field manager received information for, and access to, all of the remaining sample 
cases. The four field managers (including the phone center supervisor who took on the role of field 
manager for the phone center case-management experiment group), received information for, and 
access to, those cases assigned to the interviewers under their management. The interviewers received 




73 



information for, and access to, only those cases assigned to them. Again, the CMS retained a 
cumulative history of all attempted case contacts throughout the entire survey period, thus allowing 
review of all contacts attempted with each respondent, whether by locators, CATI interviewers, or 
CAPI interviewers. This history greatly assisted the field interviewers and managers as they worked 
together to formulate a plan of attack for each of the remaining problem cases. The CMS also 
indicated the sample type, i.e. locating problem, refusal assigned to phone center case-management 
experiment group, max call assigned to phone center case-management group, refusal assigned to field 
interviewers, max calls assigned to field interviewers. 

Field interviews using the CMS used the same process locators used to record activities and 
results associated with each case. However, whenever a contact resulted in the completion of an 
interview with a respondent, the CMS would automatically assign a final disposition to that case 
indicating that a CAPI interviewer had completed it. 

Each night, interviewers transmitted all completed CAPI cases and all updated CMS data, 
including cost reports, to NORC’s central office in Chicago. Therefore, the central office CMS 
database reflected the current status of all cases within 24 hours. This timeliness was reflected in the 
reports generated from the CMS database which kept project management and the COTR informed 
about overall survey progress, as well as the status of individual cases. 

Evaluation and future development. Compared to the system locators used for B&B: 93/94, 
the CMS received enthusiastic praise. However, there remained some frustration regarding the need, 
and time it took, to use several different screens to access data, record activities, and update address 
and phone number information for a single case. NORC is resolving this problem by developing a 
faster system and database, which requires locators to use only one or two screens for most activities. 

It will enable quicker linkages between screens and include the automatic fill of additional data items. 

Another important new CMS feature is integrated World Wide Web access. Using the same 
“point and click” interface of commercial World Wide Web browsers, locators can access Internet sites 
that may be able to provide updated addresses and phone numbers for B&B sample members. 
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Appendix B. 1993/1994 Technical Review Panel Members 


Non-federal members 


Federal members 


Professor Ken Feldman 


Dr. Cliff Adelman 


SUNY at Stonybrook 


Mr. David Bergeron 
Mr. Daniel Goldenberg 


Professor Zelda Gamson 


Ms. Maureen McLaughlin 


University of Massachusetts 


Ms. Blanca Rosa Rodriguez 
U.S. Department of Education 


Dr. Janet Hansen 

National Academy of Sciences 


Dr. Nabeel Alsalam 
Mr. Larry Bobbitt 


Dr. Barbara Hetrick 


Mr. Bob Burton 


Maryland Independent College and 


Dr. C. Dennis Carroll 


University Association 


Dr. Jeanne E. Griffith 
Mr. Jim Houser 


Dr. Larry Litten 


Ms. Meredith Ludwig 


Consortium of Financing Higher Education 


Dr. Andrew Malizio 
Ms. Edith McArthur 


Professor Richard Murnane 


Dr. John Ralph 


Harvard Graduate School of Education 


Dr. Mary Rollefson 
ED/NCES 


Professor Kevin Murphy 
University of Chicago Graduate School 


Dr. Sharon Bobbitt 


of Business 


ED/OERI 


Dr. Peter Syverson 


Mr. Daniel Chenoc 


Council of Graduate Schools 


Ms. Pat Smith 
OMB 


Dr. Dawn Terkla 
Tufts University 


Dr. Mary Golladay 
SBE/SRS 




t * 9 n 



Baccalaureate and Beyond 
Field Test. Re£ort, 1996 



APPENDIX C 
Field Test Instrument 



co 

Q 



Z 

o 

H 
U 

t 3 m 
<u m 



CO 

H 



ON 

co 

On 

CQ 

CQ 



O 

nJ 

UJ 

a: 

cu 



NO 

On 



m 



CN 



9 

o £ 

o 

in 

X 

<L> 

<D 

CO 



X 

U 

a 

u 



co 

e 

* 

> 



On 

On 



00 



ed 

<1> 



H w 



X 

u 

a 

u 



co 

W 

D 

* 

> 



CN 



O 

u 



H w 



u 



u 



co 

a 

* 

> 



On 

On 



o 

u 



u 



u 



co 

g 

* 

> 



CA 



u 

u 



V 



co 

g 

> 



On 

On 



< 

CQ 



U 



<L> 

<D 

CO 



<D 



<D 
<U 

JTn W> 

00 n> 

■Sj 

S CQ 



T3 

<D 

> 

’a> 

o 

CD 



ed 

d> 



<D 

-C 

O 

cd 

X) 

T3 

<D 

> 

*c 

o 

CD 



w -O 
ed 5 
<D O 

^ (U 

cu' o- 

m T3 
^ <D 

j* ^ 

s S 



H 

X 

W 

H 

a 



< a 

> < 



u 



u 



co 

s 

* 

> 



C73 



00 




vH 

CO 



CN 



CO 

9 z 



£ H 
H CJ 
T3 nj 
CO 

£ 
r- 
ON 

m 
ON 

pci 
*5 
PQ 



O 



NO 

ON 



m 



c 

<D 



m 

<L> 

<D 

Un 

GO 

<L> 

T3 

Un 

<u 



u 



§ g 

c /3 

Si 5 

O, cO 
cO cO 
CO ^ 

Q Q 



r- CN 



CO 

g 

9 

> 



c 

<D 

c /3 

<D 



T3 

<U 

T 3 

C 

<L> 



O 

O 

JO 

o 

C /3 



u 



— (N 

tin 



w 

O .. 

Z Ss 

< ^ 

CO 



<D 

to 

P 

-a 

co 

u 

GO 

CJ 

‘C 

a> 

c 

c /3 GO 
C u. 

o <u 

'IS 



9 



c 

<D 

C /3 

GO « 
E a. 
a> 

u b 

^ CO 

C cO 

— CO 
GO *T3 
= C 
^ o 
i *5 

§ I 

a. 
a. 



a, 

Q. 

CO ^ 

-o -5 

CO cO 
GO 

Un 
<2 
so 

JO 
(JU 

cu 

j "a> 

a £ 



- E— 

ug 

< H 

> a 



CJ 



C e 

8 i 

2 J3 

CL CO 

S 3 

cO cO 

Q Q 



^ CN 



CO 

g 

9 

> 



CN 



s s 



2 2 



u 



on 

g 

9 

> 



ON 

ON 



O 

o 

JO 

o 

CO 

<D 
-*— * 
cO 

O 3 

o -O 

JS 

8 6 

<L> u 



cO 

P 

-o 

cO 



"O 

(D 



go a- 

2 < 
T 3 u, 
<U cO 
js a> 

cO 

u T 2 
co co 
a> o 

>< 



I 



<u 



o. o. 

W 1} 

kJ -p 
W nj 

9“ 

d x 

05 uj 
H 

> c/ 



<C *0 
>< ~ 



< a 

> < 



* 

o 



CO 

g 

9 

> 



CU <-> 



O 



in 

g 

9 

> 



O 

ERIC 



o 

GO 



c/2 

Q 



<D 

H tj 
2 W 

<D C/2 



r- 

ON 



m 

ON 



o 



OQ 

$$ 

CO 



NO 

ON 



m 



ERjt 




O 



CJ 



S O 



^ <N 



C/2 



3 

> 



u 



u 



C c 

S § 
£ J3 

Q- & 



cd ^ 

tS & 

Q Q 



<N 



c /2 



3 

> 



cd 

c 

o 



'<D 

U-* 

o 



a 



O ’ — ' m 

(N 



PU 



< 

> 



S 

D 

£ 

a 

< 



oo 

GO 



CJ 



CJ 



<D 



c/i 

2 JS 

p, cd 



cd ^ 

oS 

Q Q 



CN 



C/2 



> 



o 

a 



>o 

cl 



oo 

9 z 

« 2 
£ H 
H U 
-a m 
<d oo 



^ o 

m 

9\ m 

PQ 2 
cy X 
CO 



vo 

ON 



co 



<u rts 
c3 oo 



U 



CN 



00 



CN 



* 

CJ 



00 

s 

> 



t; 

2 



u 



oo 

g 

> 



On 

On 

o' . . 

~ X 

h— I 

. . ^ 

W °° 

O 



* 

u 



oo 

e 

> 



X 

2 

oo 




U 

U 

IX] 

I 

o 



JD 

13 

E 

CD 

X 



— CN 

OO 

LU 

D 



c 

£ 

o 

c 



CJ 



1 1 

a> g 

u. -O 
d. ctf 

aj ^ 

13 'S 

a a 



CN 



00 

s 

> 



er|c 



GO 



IS1 

Q 2 
~ z 



CO 

<D 

H 



H 
U 

_ w 

0> GO 

iZ 

Cs 

to 
Os 

PQ 
PQ 



O 

nJ 



oO 

ON 



m 



o 

c 



a> 

ts 

TD 



U 



C 

<u 

C/5 



C -o 

Cl cd 

03 



03 

c5 

Q 



03 

Q 



i— <N 

go 



i 

> 



w 

|a. 

1 * 



pj 

u 

s 

H 

z 

pu 



o 

cu 

GO 
PJ 
DP 

l -g 

Cl cd 
O 

a3 



<u 

o 

os 

Dp 



nJ 
PJ 
PQ 
< 

DP 

< 

> a 



H 

X 

pp 

H 



u 



<u 

> 

cd 

z 

S u 

J8 « 

CO 

ed S 

3 -3 

"S “ 

03 



T3 

C 

C 

03 

O 



cd ^ 
.ti o 
jc J2 

^ CO 



a> 



u 

<g 

*o 

03 

CU 



c 

.2 

'55 

< 



j- 
«-* I 



— cn to 
GO 



3 

> 



V 



c 

a> 

o 

CO 

a> 

T3 

o 

c 

03 

o 



c 

03 

g 
' C 
<u 



.a c 

M S 

« S 

•- 2 
c ^ 

03 - 

S- § 

i? .ii 

PU x 

CD 



c 

( D 
O 
CO 
<U 
TD 

c .a 

<D C 
O cd 
cO rv 
0> & 

c ^ S 

§ C* 
o cd u 
% o u 
a> *3 -c 
■o a ti 



TD 
C O 

5 t: 

-O <u 
3 D 



^ r -< <-> 



(N m tt 



GO 

s 

> 



H 

Z 

B e 
Q £ 

Z o 

£-5 

go .2 

S * 




00 



U 



<D 

CO 

c 



u DU 



c 

.2 

’cd 

I 

sc 



a> 

£ 

03 

C 

aJ 



^ (N to wo nO 

o o o o o o 

GO 



3 

> 



CP 

oo 



ERjt 



05 



vo 



c n 

Sz 



£ H 
H U 

T 3 UJ 

13 00 



r- 

ON 

CO 

ON 

CQ 

CQ 



Q 

< 

o 

uj 

cl 



cu 

T 3 

c 

Cd 



o 

s 

’G 

Cd 

cu 



c 

2 

”5 

c 






- c 

5 .2 

•— C/5 

s < 



.1 III 

<«oo 



h OO on o 
o o o — 



NO 

ON 



CO 



S w 



CJ 



o 

o 

-C 

o 

oo 

-C 

op 

IS 

c 

cd 

*c 



3 

> 




oo O -C 

g UJ .SP 

Sox 



> — (Nn^-i/i\Ohoo(^o 
ooooooooo 



on 



U 



o 

o 

-C 

u 

oo 

oo 

c/5 

D 

C 



g 3 
o 

oo CD 

CO -g 
oo cd 
cu in 
c < 
'E cd 
D C 

<$ ° 
D 

-o 

cd 



o 

o 



C/5 

oo 

<D 

C 






cd 

o 

O 

> 



<D 

-o 

cd 



O 

O 

u 

oo 

-C 

.2P 

IE 

c 

cd 



cd 

g -K 

I 3 m 

cd o 

1 s 

00 « 



CO — 



cd 

CJ 

>% 



0) 
cd 

c ja 



2 o 



cd 



o 



O 

J g 5 

O 2 XI 
c/5 rr »_ 



cj 

O O 

> oo 

« « 
o £ 



(N oo 



<D 
SO 

CJ 

o 

CJ 

(U ^ 

<D O 

W) £2 
o cd 
"O <L> 



Si.* 



00 O — V 
oo fjj CiO oo 
CL> j"Z ' — <D 



— oo 5^ 
DO cfl ^ 

* fl ^ 



C/5 



« fr ;= « 

■—5 OD 05 i—J 



cd 
CD 
>*> o> 



d> CJ 

v- 

cd O 

0 E 



(N 



O 
M O 
< (N 



^MCOl->n\OhOOO\ 

OOOOOOOOO 

00 



3 

> 



QD 



o 

ERIC 



C/D 

9 z 
« 2 

T3 pQ 
_QJ GO 
£ 
r- 

On 



ro 

ON 

CO 

OQ 



O 



NO 

ON 



m 




O - (N m t 



03 



* 

U 



u 



1 1 

2 JO 

cx ^ 

c3 ^ 

c3 

Q Q 



— CN 



GO 

s 

> 



GO 

UJ 

r V2 

H a; 

i * 

GO 



GO 



o "3 

uj 

fc 5 



o 

-O 



z 

O 

CQ 

0^ 

g 

H 
O 
2 

flJ’S 

o 

j V 

w 

CO 

< 



w 

JZ 



a 



GO 

C3 



< 

> 



X 

H 

s 

H 

O 



UQ 

£ 

< 

z 

ot 

< 

> 



H 

X 

UJ 

H 

a 



o 



a 

< 



— CN 



GO 



<L> 



u 



<D 



o 



«f=CE# 

Oi 



u 

u 

s 

u 



§ g 

C/3 

K -o 

CX cd 

2 2 

c3 

Q Q 

CN 



GO 

s 

> 



o 

o 



ERjt 



Lj 



C/3 

Q 



c n 
<D 

h 



z 
o 

t — * 

H 
CJ 
-a m 
_<u m 

i Z 

r- 

£ O 

m 

UJ 

CQ 2 
cy cu 
CQ 



NO 

ON 



co 




o 

ERIC 



OJ 



r 



VALUES: 1 Yes CHECK: 



ON 



,00 

Q 



co 

<D 

H 



Z 

o 

H 
U 

T3 m 

T> oo 

£ 



on 



m 

On 

OQ 

OQ 



O 

nJ 



NO 

ON 



<D 

•£ 

TD 
0 > 
V— • 

CD 

I 

C 

o3 



* 

U 



c ^ 

<L> 2 

CO g 
<L> g 
”2 

p . 

03 2 

c3 

Q Q 



_ i (N 
00 



> 



U 



<L> 



CO 

C 

.2 X3 

s-s 

•» fe 
g c 

"T 

(U <L> 
50 ^ 
«J v- 

c J> 

is ^ 
cs a> 

P c 



T 3 

0 > 



03 



I’S 

03 O 
i~ u. 
03 O 
CL > 

o vr 
oo Q 



T3 

<D 

o 

T 3 



T3 

03 

JZ 



CO 0> 



£ 3 K 



CN m Nn no 



00 

§ 

i 

> 



H oo 



* 

U 



s o 

> 2 



C-4 



GO 

g 

3< 

> 



LO 

00 



u 



CO 

<L> O 

>- 2 



r— CN 
00 



3! 

> 



0D 



o 

ERIC 



o 



CO 

9 2 

ts 2 

£ H 
H U 

T3 LU 
<D GO 



ON 



CO 

ON 



O 

nJ 



DQ 

CQ 



NO 

ON 



co 



cd w 



* 

U 



u 



GO 



co 

ON 

£ 

o 



U 



u 




ro 

ON 

E 

o 



-o *o 

<U <D 

*€ ’€ 
D D 

o o 

CD <D 
-♦-» «-* 
oJ cd 
•*-* •*-* 
C/5 CD 



U ON 



u 



u 



co 



co 

ON 

E 

o 



CJ 






co 

§ 

> 



o 

cT 



CD 

(D 

u. 

Ci) 

D 

T3 

D 

O 

c 



OQ 
OQ 
h c 



D 

-C 



-O 

o 



o 



SJD 

c 



o 

SO 03 

c O 

. ~ ► 

SZ G— 

8 2 
fl) u 
CD 

e -O 

1 1 

Z c 

I -g 

Cl cd 

• J2 

< P 
> a 



u 



u 



00 

g 

> 



o 

ERIC 



r- 

C'j 



CD 

D5 



GO 

Q 



C/5 

<D 

H 



2 
O 
12 H 
,2 < 
(Jh qj 

ON 

m 
Os 

CQ 

$$ 

CQ 



D 

Q 

U 4 



so 

Os 



m 



(N 

G-. 




a 



u 



o 



c/5 O 
<U ^7 



(N 



GO 




Os 

o' 

so 

CN 



<o 

<D 

w -5 

^ aj 
T 3 

c 2 

o 3 ^ 

_c c/5 
+2 03 

C — 
O 3 

S £ 



<D 

JZ 

£ 

H 

X 

LU 

H 

a 



r- 

o 



2 2 
< a 
> < 



CJ 



GO 

w 

D 



(N 




u 




<3 o 

^ 2 



^ CN 



GO 



Os 

o~ 

SO 

CN 



3 

O 



c 

<u 

J= 



UQ 

H 

< 

Q 



C 73 

03 




CD 

CO 



ERjt 



S ‘<4 
**1 



<N 



CO 

Q 



CO 

CD 

H 

2 

CD 

E 

r- 

ON 

m 

ON 

CQ 

cy 

CQ 



z 

o 

M 

H 

< 

u 

D 

Q 

W 



NO 

on 



m 



O 

ERIC 




u 

U 



GO 

§ 

> 



<N 



u 



cd 



,<D CN 



§LQ 



Pu 



<u O 

>- Z 



— <N 



GO 



ON 

o' 

NO 

<N 




o- 

CD 



Q 

O 

U 

W 

H 

< 

H 

GO 

0^ 

U4 

H 

z 

W 



w 

H 

< 

Q 



w 

H 

< 

H 

GO 



cS 



CL) 

■ 4 -* 

ctf 



cd 




on on on 



O 

O 

rH 



C/2 

Q 

■*— * 
CO 
CD 

H 



12 

<u 

iZ 



2 

O 



H 
< 
U 
r- p 

S* Q 

a « 

CQ 

*5 

OQ 



VO 

ON 



ro 



&4 

U 



OO 

s 

> 





c 




c H 


*co 

CO 




.2 S 


E 




CO jL 

a) y 

3 Uh 


w 

O 




ct PU 


3 




CO U 


p 




•_= on 

S fa 


^ CO 


2 


gu 




o 

w 


2 




s 


C/3 




u 




o 

o 

JC 


U 


<D 

CL 


w 


CL 

CL 


CD 


co 


CD 




o3 


CO 


U- 

< 


CD 

CD 

o3 


5 


O 

CO 


C 


o 






03 


.2 
’ CO 
CO 


-o 

<D 


3 

O 

>2 


u 

00 


T3 

o3 

g 


,<D 


* ” 


CD 


CO 




L-h 

O 


Q. 

CL 


CD 


Pu 


3 

O 



Um "> I— I 

CL < > i 



cd 

CD 

03 

3 

O 

>% 

CD 

Urn 

to 



CD O 

> z 



^ <N 



00 

g 

i. 

> 




s — ' 


T3 


>% 


f 7 ^ 


CD 


c 






03 




CL 

CL 

03 


O 

T3 


rj 


T3 


.2 


u 


03 

-C 


a 


00 


3 


CL 

03 


Pu 


O 


< 




3 


+ 


tlf 


O 

>% 



CO 

o 



^5 

U 



s ° 
> z 



— (N 



c/2 

g 

> 



OJ 

o 



o 

ERIC 



CO 

Q 



<D 

H 



Uh 

r- 

ON 

CO 

ON 

PQ 

CQ 



z 

o 

I— t 

< 

CJ 

o 

Q 

uu 



NO 

On 



CO 



o 

r- 



co 



o- 

O 

T 3 

'cL 

Q. 

a 

3 

O 

CD 

> 

cd 



T 3 

1EL 

CL 

cd 

3 

o 

CD 

> 

cd 




CJ 

W 

ac 

CJ 



C/D 

LU 

3 

< 

> 



> 



o 

o 



o- 

-o 

<D 

Q. 

<D 

O 

o 

cd 

-s i- 

b cd 

CL Jpr 

<U U 
o £ 
o 

cd ^ 
on O 

o 

on 



O 

O 

•e 

o 

C /3 

O 

l— 

CD 

JC 



c 

cd 

E 

o 

-C 

cd 



'< T 3 

<! H 

< H 
> O' 



i 4 

O 



CO 

g 

> 



On 

o' 

NO 

of 



u 



C /3 

o 

E 

Urn 

3 

O 

C-. 

o 

CD 

cd 

T 3 



.2 5 



CO 

g 

> 



o 

o 

•e 

o 



cd 

C 

o 

•S3 

C /3 

f 0> 

O 



-n b 

(D ^iO 

=g. = s 
§■ S.H 

D -r-l “H 



UJ 



'S c — ’ 

> a 



io 

o 

!?*•«< 



> 



o 

ERIC 



o 



VALUES: CHECK: 






c/a 

Q 



<D 

H 

2 

<L> 

£ 

r- 

ON 

m 

ON 

ffl 

CQ 



Z 

o 

H 

< 

U 

D 

Q 

W 



no 

ON 



m 




>> 
O § 

o ^ 

JC cd 
£o ^ 

"O 

2 2 

GO O 

4-» S 
cd 5 

!2 <s 

cs t- 

f O ** 
4 - >, 
*o a- 

.2 S 

O. * 
CL 3 
< 



J 

w 

3 

J 

C* 

< 

> 



E- 

X 

W 

H 

a 



co 

O 

o 

JO 

o 

C/5 



u 



£ o 
^ Z 



^ CN 



c/a 

g 

=* 

> 



51 s - 

o 

vH 



U 



u 



I 



3 

O 

o 

4—* 

c 

<u 

T3 

3 



O 

„>> cd* '> 

rz: cl > 



-O 

<d 

T3 JO 

o .£P 
c M 



o 

GO 

o 





(D 

O 

c 

cd 

CO 


.2 

*■+-* 

cd 

3 

4— ► 




cd 


'co 

CO 


'co 




3 


cd 


’"cd 


4-> 


a* 




*o 


c 

<L> 


o 


cd 


c 


T3 


•+-» 


*o 


cd 


o 




c 

cd 


c 


■4— ► 

CO 


o 


C 


<L> 

co 


<L> 




cn 


E 


o 


u. 


O 




o 
-*— * 


<2 


o 

co 


’ 4 -* 

c 


CO 

a> 




"5 


cd 



X 

o 

-D 
*— * 
c 

<L> 

E 

E 

o 

o 



a> 

E 

GO O 
C ° 
- C 



= .s £ -S 



E 

cd 

Uh 



c/a 

e 

i. 

> 



cd 

CL ' • = 

•♦-> C 

o o « 



^ 1/5 
>n 

- T 3 
cd 



|s 

o *S 

'5 

s «-* 

« o 



o £ £ § S 

ZiSOhQ 



<L> 

CD 2 

O Id 

c — 

’So 

JB m 
rE ~o 
.SP’cd 



cd 

jD 



-O L- 

Cd 

fll c 

<L> 



<U 



-o 

a> w- 
co <D 

V 5 r: 



2 So 



(Nnd-^voh*5ao 
OOOOOOOo — 



C/a 

g 

> 



co cd 



cd 



£ 



CO 

o 



o 

ERIC 



MD 




G\ 



m 



U 

u 



u 



in 

s 

* 

> 



CN 

do 

Gd 
UQ 
E— • 




U 



u 




— -MntviOhooONO 
ooooooooo — 

do 



> 



CN 

in 

c£ 

UQ 

H 



rC 








CD 


CN 








O 










V=**l 


Q 

W 










s 

u . 










< b 










CQ “ 










** 










(2Q 




u 








u 


a 




u 


fe 


w 




fc 


W 




X 


<c 




£ 


C/D 


u 




C/D 


o 



£ 

o 

c 

+-» 

“c 

o 

T 3 

<L> 



cd 

a> 



c 

a> 

So^ 
5h Z X 



M n 

do 



* 

> 



CN 

do 

cC 

LQ 

H 



0-K 

a> o 

^ z 



— CN 



m 

e 

* 

> 



CN 

do 

o£ 

ta 

E-» 



O 

ERIC 



co 

o 



CO 

G 



C/3 

(L> 

H 

2 

2 

£ 

On 

ro 

ON 

CQ 

cy 

PQ 



£ 

O 

i-h 

H 

< 

CJ 

D 

Q 

w 



<D 

>> _>> 
T3 



ctf 

a> 

-c 

“c 

<L> 

> 

ctf 

I 



CU 

a- 

-*— * 
o 
c 



NO 

ON 



m 




CJ 



<d o 
>H Z 



CM 



CO 

g 

i 

> 



O 

CN 



<D 

O 

c 



5* 

CJ 



CO 

g 

> 



3 

O 

>% 

o 

o 

45 

o 







S* 

cj 



co 

§ 

> 



CO 

06 

PJ 

H 



o 

^-■4 



o 

ERIC 



oo 



u 

a 

cn" 

ON 

OQ 

cu 




o 




C 

Cd 4 „^ 
QJ cd 



*! 

u 



0*5 

v- -,J 



c 

cd 



oo 

Q 



Cfl 

<L> 

H 



r- 

ON 

m 

ON 

cd 

*{ 

CQ 



2 

O 

H 

< 

U 

Q 

UJ 



o* 

co 

ON 

ON 



KSl 

<U O 

I* 2 



(N 



00 

s 

> 




04 c/ ^ 

g * a - 

H 5 U 

C/3 QQ <2 > 

>g£g£S 




>— « cn m 
oo 



> 



NO 

ON 

CO 




oo 



C* 

PU 

H 



CO 

ON 




00 

Pi 

W 

H 




V"'’ 



Less than half time 
Not attending that month 



ON • 



c n 

Q 

00 

<D 

E— 

2 

<u 

tZ 

r^ 

On 

m 

On 

CO 

CQ 



z 

o 

I — * 

H 

< 

u 

D 

Q 

w 



vO 

on 



co 



CN 




o* 

^r 

C N 
ON 



U 



u 



<l> o 

>■ z 



CN 



CO 

g 

> 



CO 

u 

W 

H 



c 

ctf 




ei 

w 


Dei 


w 


c* 

w 




W 






w 
[— 1 


CQ 

O 


1 


§ 

w 


CU 


H 


►> 


u 


UQ 


U 


o 


w 


CO 


o 


z 


Q 



O 

c 



-o 



c 

ctf 

U 

u 

a 

u 



50 

c 

3 

c 

c 3 



LD 

vM 



c 

o 

D £ 

•i 13 

f— 5 

Cm 

T3 g> 

1 I 

u c c c 

c c w <l> 

C • — r* *- 
• — [__> TZ -M 

H , ^ 

C-. co 

zz: -— ; c^i ^ 

3 J 2 ^ 2 

p«i i j z 



^ (N ro 
CO 



4 

> 



vH 



I > 



co 

ei 

uu 

E- 




o 

CM 



CM 





O 

c 




~ fc-; 

C V 

a 1 5 
(J 



U 

a 



u 



1 



in 

Q 



<D 

H 

33 

<L> 

E 

r- 

On 

m 

ON 

CQ 

CQ 



o- 

cn 

ON 

ON 



2 

O 

P 

< 

u 

D 

Q 

w 



<u> o 

> 2 



— CM 



on 

llj 

D 

< 

> 



c 

cd 




d> « 
£ 6 



o 42 
u« S 



— 1 CM m ^ 

in 



* 

> 



NO 

ON 

m 




LO 

fi* 

W 

H 



NO 

ON 




in 

ai 

W 

H 



cr> 

S ■*' 




Less than half time 
Not attending that month 



<N 



<N 



uu 




Oh 






C/3 



u 

s 




o 




Z 




<L> 




X> 






C 


cd 




-5 


■*-* 


c 


"c 


<D 


cd 


-4— » 


u 


cd 






u 

w 




£ 

u 





CD 



C/3 

Q 

N-4 

- 4—4 

C/3 

<L> 

H 

2 

<L> 



r- 

On 

m 

On 

OQ 

o a 

DQ 



Z 

o 

H4 

H 

< 

U 

D 

Q 

W 



NO 

ON 



m 



c^-- 

NO 

ON 

ON 



ON 



<2 O 

>< Z 



(N 



c n 

s 

•i. 

> 



in 

Oh 

UJ 

H 



c 

cd 




C 

o 

E 



<D 



U- 



C/3 

g 

> 



<D 



<L> 


•4—4 


E 


cd 

JZ 


■*— * 


•4—4 




00 


cd 


C 


JZ 


’-5 


c 


c 


cd 


<D 


JZ 

•4—4 

C/3 


-4— ► 

td 


C/3 


•4—4 

o 


-J 


z 


m 





(X 2 



on 

C* 

UJ 

H 



00 

i 

<^/=q 




(N 



GO 

Q 



C /3 

D 

H 



IE 

< d 



Z 

o 
p 

r ^ 

(-4 (j 

r- 
ON 

co 

ON 



D 

Q 

W 



DQ 

*5 

PQ 



NO 

ON 



co 




CL<fc 



* 

u 



u 



<D O 
^ 2 



r-H (N 



C/3 

s 

* 

> 



GO 

aC 

W 

H 



go 

H Q 



— CD 

CD P 
on <L> 

O D o3 00 
° M-g -§ 
O « | 

c D 
C O CD 
!d C D 

U - 

u 



u 



D 
-*— * 
o3 

o 



t: 

D 

CD 



g D 

g> 00 

T 3 -a 



D o3 



CD 

CD 

00 

CD 

-a 



c 

CD 

o 



C /3 



C /3 



<P -u 



O 13 O 



o 

o3 

OQ 



a3 

D 

u. 

15 

o3 

03 

CD 

CD 

03 

Xl 

i 

t /3 

O 

cu 



CD 

CD D 
O- <D 
on u. 
_ 00 
OJ CD 
C T 3 

.2 1/3 

E “w- 

o3 d> 

CD ^ 

3 g 

T3 5 
U) Z 



D 

D 



<D 



03 

C ^ . 

O U 03 

‘S £p,E 

on <D 

,(D TD 



O ’ 

t— 

Q. 



03 
»- 
O 
'♦— » 
CD 
O 

£ Q 



t: 

CD 

CD 



£ 

ctf 

u 

00 

o 



<D 

<D 



on 



u- 50 
00 CD 

cd -a 
-a 

C 03 
O 3 

2 Q 



^C'lroTtNnNor-'OooNO 
ooooooooo — 

GO 



1 

> 



GO 

oC 

uu 

H 



GO 



o 

c /3 

CO 

cu 

< 



00 



«\* 



U 



u 



<D 

03 

3 

T3 

03 

£? 

D 

T3 

C 

.3 

"d 

13 

3 

d> "O 

15 * 



3 00 



D 2 

13 oo 



-a 

«D 



3 

-o 

03 



te -g 

-a £ 

c o 



jj a o u o 



(N n 't 



GO 

g 

> 



GO 

tC 

W 

H 



o 

ERIC 



•i 



m * 

<N 



C/5 

Q 



C/3 

05 

H 



z 

o 



2 

0) 



ON 



CO 

ON 



H 

< 

CJ 

D 

Q 

up 



CQ 

** 

CQ 



NO 

ON 



CO 



o 

ERIC 



f* 

*• 



TD 

05 



c 

05 




05 

£ 



3 

O 

>> 



E 

ctf 



50 

o 



05 

cl 

>% 



as 



CJ 

C/5 

PQ 

CL 

< 



as 



cj 



cj 



05 



as 

O 

yo 



tc 

05 

O 



05 

05 



05 

05 



05 CCS 



50 

05 

T3 



05 

C/5 

C 

05 

O 



» 5b 



05 

T3 



C/5 

~05 



05 

T3 



O 

05 

CL 

C/5 



O 

o 

in 

n 

< 



M u « -5 



« g 

« 5 
50 c n 
05 V? 



u- aS 

50,2 



T3 c2> 



2 y> o 2 



o 

aS 

PQ 



05 CL O 



t: 

05 

O 



~ rt 05 



C/3 



u 
O 

ix Q 



^cNn^-inNOhoo 



C/5 



3 

> 



C/5 

oi 

UP 

H 



>4 

CJ 



CJ 



C/5 



> 



C/5 

UP 

H 



05 



i— i as 



Z'i £ S3 



CO 

05 



*4 

O 



u 



aS 

O 



ts 

05 

O 



05 

05 



g>-a 

05 ^ 



aS 

05 



T3 



05 

E 

'o 



aS 

O 

O 

aS 

X) 



C/5 

< 



O 

aS 

PQ 



C/5 

O 

CL 



^ M n 



C/5 



«! 

> 



<M 

O* 



C/5 

pci 

UP 

H 



TT 

<N 



GO 

Q 

CO 

<D 

H 

<u 

E 

r- 

ON 

CO 

ON 

DQ 

*5 

CQ 



z 

o 

H 

< 

CJ 

D 

Q 

W 



s 

'3 

D D 
Q. <D 
co w 
— Of) 
ctj a> 
C T3 

.2 y> 

c« (1> 

§ « 
-a * 
W 2 



<D 

<D 

W 

00 

<L> 

T3 



O cd 



ON 



CO 



<u 

CO 

c 

<L> 

O 



<D <u 

a> ts 

DO <-> 
0) ^ 

■° c 

<L> 
O 

a. o u. 

« « M 

. hr O • 

£ Q O 



t »n vO h oo 




* 

U 



GO 

s 

i 

> 



oo i 
fi* I 

w 

fc I 




ii 



CJ 



GO 

s 

> 



00 

ceS 

W 

H 



iO 

CVi 




Q 

w 

-J 

J 

O 



«tS< 

Cvi 



O 

ERIC 






C/3 

Q 



vo 

ON 



m 



U 



u 




cd 

o 

«G 

'€ 

43 

O 

0> 

s to G 

2 « g 

00 £jQ u- 

*' 43 3 

*X3 J2 
co 
43 

o 

43 



43 

T3 



co 



.2 — 



I 

H 



u 

o 

co 

co 

< 



O 

cd 

CO 



o 

43 

CL 

co 

"cd 

C 

.2 

cd 

o 

3 

-a 

UJ 



43 

43 

u- 

00 

03 

-a 

43 c 
2 § 
00 co 
D co 
T3 

CO 



43 

CO 



43 

O 



43 43 

03 

u. cd 

oo a 

43 *G 
T3 



O 

l- 

O. 



cd 



S £ 



o 

o 

O 



t: 

43 

O 

u. 

43 



o 

S 



c/3 



i 

> 



C/3 

a! 

UJ 

H 



C/3 



U 



c/3 

C* 

w 

H 



^ (S n 1- 



cd 

c 



T3 

43 



CM 



u 



u 



cd 

L3 



43 

T3 

co 

"43 

2 

'5 

o 

co 

CO 

< 



C/5 

S 

> 





*g 






03 






r 






43 

l. 






43 

u 


CO 




00 

03 






43 


"cd 




-O 




43 

43 


cd 

43 


O 

43 


43 


"cd 

c 


43 

43 

u« 

00 

43 

T3 


oo 

43 

-a 

JO 


i_ 

03 

cd 

cd 

0 


CO- 

co 

"cd 

c 


43 

u 

00 

43 

-a 


.2 

*co 

CO 

<2 


“U 


0 

cd 


.2 


JO 

\m 


0 

L- 


"cd 

u 


"43 


O 


td 


43 


a- 


O 


X 

0 


1 

•*— • 
CO 


03 

3 


to 

cd 


CO 


O 


cd 

CO 


0 

CU 


“O 

UQ 


La 

£ 


O 

Q 


<N 


m 




vn 


VO 


r-* 



cd 

03 

<G 

r 

43 

03 



CD 



c/3 

ct 

w 

H 



9 

ERIC 



vO 

CN 



c/3 

Q 



4> 

H 

12 

.2 

£ 

Os 

m 

Os 

CQ 

oa 



z 

o 

H 

< 

u 

D 

Q 

w 



VO 

ON 



m 



<N 



W 



*4 

u 



u 



C/3 

g 

> 



C/3 

c2 

UL| 

H 



T3 

4) 



u 



V 



03 

o 

cc 

'€ 
4) 
O 

CD 

<u 8 c3 

w 4) 

so to § 



u 



« « 
73 -o 



03 



vi 



VI 



£ -i 

2 .o 



03 
U 

O £ 
4) -O 

o -C *L 

w o 

< oa cu 



o 

4> 

Cu 

vi 

15 

c 

o 



4) 

4) 

l— 

50 

4> 

T3 

15 

c 

o 



4) 

c/i 

C 

4> 

O 



50 Vi 
a/ vi 

"O 



4> 4> 

<D 

u- 03 
50 <-> 
4) Cf5 

-a 



.2 y> o 15 

V— 

4)0-0 



03 

O 

3 

W 



t: 

4) 

O 



Vi 



O 

o 

£ Q 



«— .(Nm’^fv^v.or^-oo 

C/3 



3 

> 



C/3 

C* 

w 

H 



’ Uu 



* 

U 



u 



C/3 

g 

> 



C/3 

c* 

w 

H 



03 



CO 

03 



u 



u 



c/3 

g 

$ 

> 



C/3 

C«4 

W 

H 



o 

ERIC 



co 

cm 






c o 

Q 



CD 

H 

12 

CD 



r- 

ON 

m 

ON 

CO 

CQ 



z 

o 

H 

< 

U 

D 

Q 

lu 



\D 

ON 



m 



<D 

D 

!— 

00 

CD 

T3 



1— 

CD 


"cd 

3 




> 


T3 




CD 


03 




C 


u- 

00 




u- 

O 


_c 




T3 


TO 


s 


<D 


a> 


03 


> 






’C 


o 


00 


o 


Urn 


o 


D 


c 


u- 


u- 


CD 


CL 



u 



a3 

CD 

S3 

CD T3 
C 

^ O 
c/2 o 

b ^ 
Ll, CO 



o3 

CD 

-C 

u. tc 

u- cS -j 

C3 0> o 

CD 

^ _C CD 

•a t > 

.b 5 o 

rC O -O 

h Pu < 



, — <n m 
on 



4 

> 



CO 

C* 

W 

H 



CD 

a> 

s— 

00 

CD 

T3 



C 

o 



u- 2 
<D 3 

& 13 

c ob 



00 
O 

c u- 
<D CL 



O .S 
S^-a £ 

- 3 1J U 03 

o-.> = ‘ 

« s s 

■■ JZ V 

W h u 

Ss: 

i ^ 



.E c^* 

O O 

£ X 

U 



<D 

£ 

1= 

03 



CO 

OQ 

CL 

< 



00 "XD 
O CD 

&•■§ 
(D CD 



03 

3 

T3 Is 

03 L. 

oo 3 
3 O 



03 



3 

O 

>% 

C 

CD 



E 

03 

u- 

00 

o 

u. ^ 
CL ^ 
a 

03 

X> 



3 

O 

>% 

CD 



C/2 

o 

CL 

LU 

OQ 

< 

J 

o£ 

< 

> 



lu 

CO 

c £ 
X 
O 
u 

CQ 

CL 

ui 

S 

< 



00 

c 

o_ 

03 

u. 

,03 

0 

1 

H 

X 

LU 

H 

a 



E 

03 

u- 

00 

o 

U~ 

CL 

<D 



* 3 

-O r9 

03 w 
l— 

00 



c /2 

E 

3 § 

CD .2 

b s 

03 

.£ 8 

E 4s 

U3 T3 
a> u- 

Q. ° 

l-s 

.E ^ 

03 03 

3 C 

0£ 



3 

O 



CO 

<N 

<N 



s 

D 



< a 
> < 



o 



T3 

CD 

tc 

03 



C 

<D 

> 

03 

I 



C 

o 

00 

c 



TO 
T3 £ 

£ 3 

CD o" 

I" 0 

o z 



. — <n m ^r 
co 



> 



CO 

06 

LQ 

H 




CO 



u 



co 

LU 

D 

* 

> 



O 

CO 



co 

oi 

LU 

H 



ERIC- 



00 

<N 



00 

Q 



D 

H 

33 

<d 

E 

r- 

ON 

m 

ON 

PQ 

<y 

OQ 



2 

O 

H 

< 

U 

D 

Q 

w 




NO 

ON 

^ >• 

ro 



D 

> 



OQ — 



X 

U 

cu 

I 

U 



D 

CSi 

3 

O 



c 

CD 

E 

t: 

cd 

CL 

00 cd 

.S <d 

- - 4— » 

cd 
> 
*0 
CL 
cd 
c 



3 

O 

_o 

-a 

CD 

c 

£ 

o 



o 

o 



3 
CL 

E 

cd 
o 

* ft! 
J5 O 



c 

CD 



CD 
c n 

3 

O 

CL 

C/3 

c/f 

3 

cd 



cd 

3 

00 



c 

D 

u. 

cd 

CO CL 

1 s.S 

-2* ! 
cd )- 2 

3 4) .O 

§>« 2 

O cd 

° c* £ 

2 £ o 

s| g 

cd — 



CL iz 



CD O 



-B -£ = 
£ £ S 



— CN m cr> 

co 

uj 

D 

> 



GO 

C* 

CU 

H 




ON 



CD 

C ts 



D 




> 




3 '53 




>™> o 




e « 




2 3 
<h o 








cd 


o- 


X *3 


D 


U "3 


D 

c 


00 o 


cd 


2P "§ 


4—4 

GO 


CL w 


' 55 


< -a 


c n 


t3 .2 


cd 



2 M s 



CD 3= 

E 



m £ 

ON 

ON CD 

— r 3 

3 4- 
•— > 3 

-rj O 

<D -2 
cd 



00 
_c 
' c 

3 

Q 



c 

cd. 



CD 



X CD 
ON CD 

- 2 

to 



> 

'53 oo o co 

“ CO on 



u 



U 



12 


D 


cd 


Yes 

No 


3 

lo 


C 
3 
•— > 


23 

o 


4—* 

£ 


O 

4— » 


c 

cd 

c 


O 

Z 


X 

ON 


% 


—4 (N 




ON 


c 


GO 

w 


H 




cd 


X 






5 


tu 








H 






< 


O' 






> 



on 

c* 

W 

H 




U 

GO 

PQ 

cu 

< 

00 

c 

43 

c 

CD 

4— » 

cd 

CD 



”3 

CD 

> 

’53 

u 

<D 



CD 

> 

’53 

o 

<D 

u- 

3 

O 

>> 



.id ”3 
«2 ^ % 
°-g° 

C S ' L- 

3 -C « 

o o °- 

C D <*i 

| Ex 

i £ 00 



a 

u 

s 

u 



O 3 

2 ’5 




3 


00 


H ^ 


UJ 


X 


D 


W 


-J 


H 


< 


a 


> 



GO 

W 

H 




(D 

> 

’53 

o 

D 



§ tu 




erIc 



CM 

CO 



ITERS: 4 VALUES: 1 Free or reduced tuition; Tuition waiver CHECK: 

2 Scholarship, fellowship, grant 



..ON* 

(N 



C/3 

Q 



<D 

H 

2 

cd 



2 
O 

H 

r < 
Uh (J 

r- p 

^ Q 

g W 

CQ 

QQ 



CO CO 

Q- Q- 

IE IE 

CO CO 

C C 

cG cG 



CO CO 
CO CO 
CG cG 

00 JC 
C O 

2 

o 



C3 

CD 

C 

CD 

_o 

c 

o 



X 

o 

X) 

c 

<D 

E 

E 

o 

o 






ca 52 

— CD jj* 

cG co cG 

CD <D O 

hoi J 



cG 
CD 
3 

T3 . „ 
U >> U 

<D ^ « 

“ 3 & 

CO v ✓ 

2 ^ u. 

o.j= 2 

S o -C 

U 1 > O 



m ^ vo r- oo 



vO 

ON 



m 




U 



C/3 

s 

> 



C/3 

w 

H 




CG 

c 

.2 
* co 
CO 

.CD 

<4-1 

o 



in 

co 



u 



CD 

E 



"O 

o 



CD _ 
Q T3 
<D 
"O 



t: 

0 

X 

co 

C 

1 

cG 

v-. 

00 

o 



<D 

<D 

c 

2 

2 

2 

’5 

c 

cG 



CO 

<D 



0) 

CO CO 

<D co 
co <D 

c — 

O <d 
Cl 

X « 
<D £ 

o S 

OJ co 



-o 

CL) 

c 

CD 

E 

E 

o 

o 

CD 



O 

o 



a T3 

r vS 

O T3 
co c 

2 s 

o c5 



so 

.E 

c 

CD 

00 ^ 
C CG 

-3 <d 

■1 



cG 

a> 



CD 



_ . ^ E 

a. jz o 



c o 

1 1 

~ o 

CD CD 

a3 E 
-C o 
£ -C 
-o 2 

S CD 
cG co 



"O 

c 

cG 



1 *8 

C c 3 

r r~; • — O 
^ cc •- 

§ 2 3 

U O h 

. — (N m 

o O o 

C/3 



00 

c 

’> 


u 

cG 

3 

O 


E 

«2 

CO 


o 

o 

_c 


l— 

o 


•c 

cG 

CD 

*> 


CD 

CO 


2 

o 

CO 


l— 

<D 


'€ 

cG 


3 

C 


o 

CO 






2 

o 


O 

O 


J= 


Cl 


2 


co 


c 


C 


-C 




4— > 

o 


< 


' a 
tx. 


2 

4—* 


cG 

a 


cG 

O 


U 

V) 


CD 

C/3 


rr 


m 


VO 




r- 


OO 


On 


O 


o 


O 


o 




o 


o 


O 





C "O 
o <D 

^ s § 

•E 3 £ 
3 CX _« 
c V 

£ u- >, 

E T3 -O 
O O 3 
CD O co 
&Q 00 <4-4 
C cG ° 
’-a co cd 
c CG « 

g -C 3 
o >, o 
t £ o 
3 3 CD 

* 2 Jc 

CD c2 ^ 

w o 0> 

— o £ 
^ C/3 O 



CD 

E 

-o 

CD 



cG 

3 

-3 

cG 

1— 

00 

u. 

<D 

-o 



c 

cG 



O 

O 



o 

co 



<n 



3 

> 



•G 1 

co 



C/2 

ai 

tu 

H 



o 

ERIC 



co 



o 

m 



oo 

Q 



0 ) 

H 



r- 

ON 

m 

ON 

DQ 

PQ 



Z 

o 

p 

< 

u 

D 

Q 

X 



vo 

OV 



m 



x 

o 

X 

'fa-* 

c 

d 

E 

E 

o 

o 



cd 

X 

Urn 

d 

> 



c 

X^ 

u. 

D 

X 

-fa-* 

O 

x 



D 


D 




> 


-♦—* 




<D 


cd 




C 


3 




0 -H 


T3 

cd 






w. 




c 


00 




o 






C 




to 

D 


-o 


E 


3 


D 


cd 


CT 




V— « 


GO 


O 


oo 


Vn 


o 


X 


c 


Lm 




D 


CL 



cd 

c 

o 



U 



IS 

d 



c 

d 



3 

O 



X o 
S >* 
« c 



5 *> 

O U 

>* c 

= 5 

te « 

<U Uh 



c 

O 

GO 

cd 

D 



,o 



cd 

o 

cd 



go o 
CD u. 
C 
D 



D 

■*—» 

C 



.= ■£ cd 

00 5 c 

D 
X 



3 

O 

>% 



5 o C2 

o 03 -a 
O O D *- 
H H ft. O 



« — CN m 'rf 
00 



3 

> 



00 

dp: 

X 

H 




eg 

<j 

-a 

c 

D 

c 3 

Sr* 

d Id 

O 13 



cd 

-a 

c 

D 



3 

O 

>> 



c*-. rs 

O ~0 
Q£ 'o 

E -a 

P 



J 

X 

3 

X 

fid 

< 

> 



d 



H 

X 

X 

H 

a 



<j 

00 

DQ 

X 

< 



H 

< 

x 

S 

< 

z 

< 

> 



tt 

(N 



D 

Z 

a 

< 



u 



CO 



GO 

S' 

S ^ 

CD 
D 



r- fa u> 



x 42 

op ^ 

c D 
^ X 
D D 
D CD 

£ 



, — CN m 

oo 



3 

> 



oo 

c* 

X 

H 



I 

00 




D 

8 I 

! ■§ >> 
x u- -a 
o gp £ 

~ fli « 12 

*v CD u- cd 

c -a r= i- 

cd C * 00 

U 3^-0 

<l> co 

CD 



X 

U 

e 

u 



> Vi* 
- 

fa* (i \ t— 

oo g oo 

CU S CD 

3 u 3 




o 

ERIC 



o 

CO 



VARNAME: ENROLEXP VARLABEL: Enrollment plans 3 years later. RANGE: , 

AQ NUM: 244 QTEXT: Three years from now, do you plan to be enrolled in school SKIP: To INTENSH if 2, 3, 



vu " 
cn 



on 

Q 



CD 

H 

12 

<D 



2 
O 

i— « 

H 

r < 
CJ 

*> 

ON 

m 
On 



D 

Q 

W 



PQ 

& 

CQ 



NO 

ON 



m 



Q 



o- 

<D 

d> 

u. 

00 

<u 

T3 



c 

o 

00 

c 



o 

£ 



cj 



CJ 



<D 

<D 

g 8> 

00 4 -» 

(U C/l 

•s J* 

If 

CU <D 

E > 
o o 
o o 
o 

<U L- 

■c 12 

I>* 2 ^ 



— (N 

on 

LU 

D 



H 

X 



cj 



U 



on 

s 

> 





2 

on 




CJ 



CJ 



on 

s 

* 

> 



CU 

1-^ 

X 

on 



o 

<u 

s 



CO 



<L> <D 



H _ 




CJ 



cj 



<D g 

E | 

= tr 

3 «* 
LU 



CN 

on 

LU 

D 



on 

c* 

LU 

H 



a- .a 



hS £ 



CD 

CO 



cj 



cj 



72 

*c5 

cu 



on 

g 

* 

> 



00 

CO 



on 

c* 

LU 

H 



o 

ERiC 



<N 

co 



a| 

H 
CJ 
uu 

<D 

£ 



<u 



z 
o 

H 
< 
CJ 

DQ 3 
oy Q 

3 w 



On 

m 

ON 



X 

On 



m 



‘3 

cx 

c 



<N 



O 

o 



o- 

Q. 



c 

1— 

<D 

C 



<u 

> 



u 

cj 




c/3 

C* 

W 

H 



CJ a* 

S Q-i 

2 

CJ oo 



cj 



oo 

s 

> 



00 

04 

W 

H 



o 

d> 

13 

a 

-o 

03 

u. 

ao 

o 






*5 

CJ 

W 

DC 

CJ 



2 
<D 
X 
^ a> 







a> 


X 






X 








<u 


c 






X 










X 






c 


o 






>> 


rs 


*o 




-o 


’ c3 


3 

to 




3 

to 


a. 

03 


<L> 






T3 


13 

3 

TD 

cri 

u* 


IS 

<l> 


C 

.2 
* CO 
CO 

X 


C 

03 

>>' 
T3 .' 
3 . 


ao 


<D 


X 

o 


to 


i— 


X 


l— 


<L> 


o 




a. 


c 

X 

o 


c 

X 

o 


te or 


13 

3 ’ 
T3 < 
c3 



3 ^ 

C3 '3 

o- a. 

2 * 
<v o 

X ^ 
.tS T3 

<L> <L> 

Z J 



3 00 X) 

-OXO 

2 o 

O O U 
^ «-» c 
T3 -O jfiJ 
a> <d X 

J J o 



(N m wn 



00 
LJ 
'D 

1 

> 



00 

06 

UJ 

H 



O 

*2* 



o 

ERIC 



m 

m 



vo 

ON 



m 




<D 

-o 

cd 

u- 

50 



O 

o 




U 



U 






> 



o> o 

>- 2 



CM 



CM 

<+* 

> 



C 

o ^ 



UJ 

O 

Z 

< 

c* 



o 

* jl y 

o> X A 
3 U U 
°^< H 
- U 
f H 



CO 



Q 



o 

H 



<D 

-o 

cd 

u- 

50 

o 

o 

_c 

o 

c/a 

<D 

i— 

CL 



<D 

_C 

o 

cd 

<D 



<D 



cd EX' 
CJ > 

cd «* > 

0> -o i2 
<D •— 

.s s 

cd 2 
T3 u -C 

o> +-* o 
- u- 5/3 
§ J5 

t .2P 



cd 



c 

'cd 



<D 

> 

UJ 

J 

LU 

pa 

< 

nJ 

0^ 



>> o 

(D « 

£ 2 



X 

UJ 



< H 

> a 



o 



u 



S O 
?H Z 



— CM 



co 



> 




u 



u 



cd 

E 



50 



C 

a> 

tt c 

cd <D 

W) t 

cd 



■£- ^-2 
b 5 § 

^ c •— 
c § ^ 

g E o 

C CD _c 



<D 

-a 

c 

15 

<D 



^ a> 



50 o 



o 

C/3 



<D 

-a 

c 



cd <d 



<D 

C 

<D 

o 



~0 

~0 



O 

C/3 



50 

£ 



^ (N m ^ m vO 
O O O O O O 

CO 



■i 

> 



ERjt 



co 

Tf 



CM 



^r 

m 



c/3 

Q 



03 

H 

33 

.2 

£ 

ON 

m 

ON 

cd 

CQ 



2 

O 

H 

U 

w 

C/3 

0 

s 

1 

u 

< 

ou 

H 



NO 

ON 

r- 



<N 




03 

T3 

cd 

Urn 

so 



H a 



CJ 



vj 

<u o 

> Z 



— <N 



C/3 

g 

> 



o- 

50 



U 

w 

X 

CJ 



& 

cd 

E 






c 

oj 

V 

cd 






03 

"O 



o 



50 

L- 

03 

T3 

C 

2 



2 c 

C 03 

S E 

E 03 

-2 13 

03 

L- cd 



b-1 

cd 5 

-4— > -3 



03 

C 

03 

o 



o 

o 

JC 

o 

co 

-2 

T3 

-o 



o 

o 

JC 

o 

co 

J3 

50 

a 



— <N m *r> NO 

o O o o o o 

C/3 

m 

D 



to 




o 

cd 

03 



o 

ERIC 






Tf 



VALUES: 1 Yes CHECK: 



m 



vo 

o' 

iD 

cn" 



U 



C /3 

s 

> 



(N 




o 

X 

u 



E «* 
o S 
u <u 



C <u 50 
E T3 C 



<3 O 

> Z 



— CN 



on 

W 

D 



VO 

O 

o' 

vn 

CN 



W 

a 



QJ "O 

-S C 

-o o 

&0 

•§ 0 > 

O .t 2 
cd t: 
OJ 5 

H o 

• • <D 

^ o 

U <S 

H £ 

U «o 



on 

§ 

> 



oo 

VO 

CN 



2 z 
< a 
> < 



VO 

o" 

vn 

cnT 




U 



00 

§ 

> 




CD 



o 

ERIC 



C75 

***** 



so 

m 



co 

Q 



<D 

H 

12 

<v 



Z 

o 

H 
CJ 
UJ 
co 

E O 



Os 

cn 

os 

co 

DQ 



I 

CJ 

< 

UQ 

H 



so 

Os 



m 



(N 




< 2 ? o 



* 

CJ 



CJ 



o 



o 

2 



^ <N 
CO 



4 

> 



H 

< 



(N 



03 

C 

o 



T3 

T3 

03 

>* 

C 

03 

C 

•o 

<d 



o o- 

r 



C/5 



> a 



* 

u 



cj 



<3 o 

>- z 



— . <N 



CO 

g 

4 

> 



U 



o 



o3 



03 



l£- N* ^ 
£ « £ 



CO 

g 

4 

> 



O- 

c 

.2 

2 

o 

to 

tS 

CD 

o 



CD 

> 

CD 



c/i 

D 



CJ) 



CJ 



CJ 




so 

°\ 

o' 

<N 



CJ 



CJ 



co 

§ 

4 

> 



O 

ERIC 



•co 



m 



CO 

Q 



CD 

H 

-2 

£ 

r- 

On 

m 

ON 

OQ 

OQ 



Z 

o 

H 

U 

oq 

co 

O 



X 

u 

< 

OQ 

H 



no 

ON 



cn 






cd 



u 



x 

o 

JO 

c 

E 

w w E 

C3 Kl Q 
O O ~ 
C C C 



to 

<D 


t: 

03 




O 


O 


O 


b 


>% 

o 


<D 

O- 


ctf 


c 


CO 


u_ 


03 




O 

CL 


SP 




E 


CD 

E 


u 

-C 


CD 





^ (N n m oo 
o o o o o o 

CO 



u 



U 



c/a 

03 O 

^ z 



CN 

CO 



i 

> 



CD 



CN 



u 



u 



co 

s 

* 

> 



c/a 

C 

.2 

13 

‘E 

KJ 

<30 



<30 

c 



03 



o 

Z U 

03 

O »- 

^ CD 

H £ 

< O 

y e 

2 



H 

Oi 

OQ 

U 

OQ 

H 

< 

H 

co 

Z 

o 

z 



e 

.2 c- 
13 J2 
^2 o 
c*-. o 

'p 

8 8 
<D 

CD £2 

> s? 

flS > 

J= *c 

D °- 
O c/a 
>% «J 
O -G 

Q = 

. . c/a 

H w 
X 
OQ 
H 

cx 




in 



u 



o 



c/a 

03 



03 .2 

>H Z 



^ CN 
CO 

g 

> 



o 

m 

rH 



0 

ERIC 



CO 

to 



00 

m 



m 

Q 

cn 

<D 

2 

CD 



r- 

Os 

m 

On 

CQ 

°y 

00 



Z 

o 

H 

CJ 

w 

m 

O 

S 

u 

< 

w 

H 



nO 

ON 



m 




c^- 

-C 

o 

a 

CD 



* 

U 



ctf 

E 



-C 

550 



C 

CD 

S C 
c 3 (D 

SP t 



c 3 



CD 

T3 

C 

2 

CD 



So « 



CD 

T3 

C 



cu U 



<D 

O 



c 

3 

O 

o 

_c 

o 

C/3 

2 

-o 



a. -a 
a. £ 

O S 



o 

o 

-C 

CD 

c/3 

_C 

550 



(N n in vo 

in 



> 



UJ 

a 

z 



<N 

U 

H 

< 

y 
□ 
* cu 
cu 
< 
o 



* 

Q 



m 



u 

<D 



-O’ 

3 



2 

*5 

CD 

CU 



a 

U-T 

Qd 



co 

CD 

ts 

CD 

tS 

*£ 

CD 

CD 

4— < 

CD 

D 



■§ H 

3 

— tu 

.2 U 

CD 

CD 

CD UJ 

c n u 
. . < 

U u 

“ 7 



5 



H 

d x 

fid UJ 

< H 

> a 



H 

at 

UJ 

u 

QJ 

D 



a3 
CD 

'€ 

. CD 
CD 

00 

c 

2 
o 

cc 3 

CD 

>% 

* % 

> C 

5 

-C E 

5 So UJ 

9 C/3 

o -§ S 

Q <D 1 



c^* 

co 

c 

<D 

E 

(D CD 
> 2 
S o 

-c ^ 

3 C 
O *D 
>■% '*— * 

o « 
73 S' 

« 5 

03 , — , 
CD g 
U* * Q 

‘-P <D 

5 g* 

o 2 

H o 

CO 

UJ £ 

O C3 
tH 

uj S 
d 6 

< u 
3 00 
5 .E 

>% _C 

2 8 
^ <D 
C ^ 
O U. 

• — CD 
. — DU 
-O 

*T3 O 
* >. 
J5 g 



u 



CO 

<D O 

> z 



— . CN 



m 

s 

* 

> 



a\ 

00 



C /3 <N 

ui 



< 

z 

cc 

< 

> 



D 

Z 

a 

< 



a. 

5 

C /3 



ft. 



u 



b 

cS 

c 

<u 

E 

_43 

W 



c £ 

'5 .2 



CO D 

•S 5 



CD 

C 

<D 

a 



C 

3 

O 

CD 

CD 

< 



cS 

CU 

3 

CD 

O 

o 



Ih r/5 
00 3 
< OQ 



cd 

CD 

X 



a 3 



3 

-a 



(N n in \o h 

o o o o o o o 
in 



4 

> 



O 

ERIC 



03 

lO 



ON 

m 



to 

io 



<D 

o 

c 

o 

o 

2 J 

x o 

• — OJ 



CO 

3 

TD 

C 



C 

o 

'S 

o 

o 

T3 

> w 

15 

c 

o 



"O 

c 

cd 

<U 

T3 

cd 



<L> 

O 

c 

<u 

o 

co 



c 4 - a; 

M— < Cd C— t 



<D 

O 

c 

<u 

o 

CO 

<u 

o 

cd 

cx 

CO 

"a3 



a> 

'5 

CO 



2 H H O 



C 

<+* cd 

C 

gi . 2 GO OT 

o 5 £ o y 

o S ‘ 



r, ' . ” on w 3 w 

“>•§ O .2 Cl .2 « 
— S "5 S2. E S£ "S 
.2 -= 2 j=“ o « 
CQ <~> O CL, CJ CL. 2 



<L> 

O 

c 

<D 



<D 

c g 

.2 g 

o (U CO 

^ O H 

fc w t 3 

"3 cd £ 
sr n ^ 



a> 

-C 



c 

0-2 



cd 

o 

3 

T3 

<D 

15 

OX) O 

c c 
u 



c 

o 

cS 

o 

3 

T3 

W 

15 

CO 

<D T3 

oo S 

Z3 qj 
cd -T3 

= s 

.SP « 

<D S3 



<1> 
c 

<D 

a pq £ 



s C x: 

Cd cd C/3 

E c 'vi *E 

v-. co a3 

cQ 3 CL X 

O J cC on O 



CO 

o 

’co 

cd 

CQ 



00 

c 

*5 T3 
cd <D 
<U X) 
J= IP 

^ 5 

O to 

"O ^ 

U 

cd >* 



T3 
C 
cd 

5 £ <«- 
- ~ cd 

<L> 

Q 



cd 

c 

•2 -a 

o « 
c 

w a 



T3 

<U 

« & 

T2 S- 

c5 .o 

s- C 

s. cd 

= ^ 
cd ^ 

C TD 



T3 

(D 

a. 

a. 

cd 

O -X 3 

1 8 . 

1 8- 
^■2 
— T3 

2 § 
<D 

Cl dj 
O u 



.55 T3 
.t; g 

15 ’5 

cd O- T3 

CO c <u 

« -S g; 

00 « 5* 
c rP o 

. — cd •*— 

.= 3 ”2 
00 £ 
c 2 

cd 



<D 



s c 



cd 

_aj 

o 

u 

CL) 

a. 



^ £ 

2 § 

V 

CL • — 



— i-i. ir- w-u — 

O CO CO CO > CO O 



tr c 

g .2 § 

<D w 

00 5 -o 
C 3 o 
2 ^ o 

cd w co 
2 .2 cd 
T3 

U Q. f 

'8 £ g> 

(S 



C/3 

tP 

< 

a> 

oo 

cd 

3 

00 

c 

Jj E 

I— I C/3 

ri g 



00 

c 

LU i 



ooGno — cM^^r^Nor^ooGNO — <Nf^^rwn\or^oooNO — cNr^^r^Nor-ooGNO — cs 

O O — — , — — , — — r^(NCN(N(N(N(N(NCNCNmmmmmmmm< HF N^ T:: J‘ T: 3 _T: J 



NO 

ON 

m 




in 



o 



co 

Q 



<u 



2 

O 

h-H 

H 
CJ 
W 
u ^ 
£ O 

r- 2 

ON 



co 

ON 

QQ 

$$ 

OQ 



X 

U 

< 

UQ 

H 



vO 

ON 



r<o 



c /3 

o 

^5 

Z 3 
■*— * 
CO 

c 

cd 

u 

‘C 

o 



CD 

> 

'♦— * 
cd 



.2 

-5 

c 



c 

GO cd 

C .o 

-a 
cd 
CL> 

a: 



a> 

o 

c 

cd 

*o 

CO 

Id 



CO 

co 

OJ 

^-o 

13 



>% 

-C 

g- C CO 

On 

on . — 

^2 .£P •- 

’a? o 



CL) 
■*— » 
cd 
<u 

-C 

H 

'cS 

B 

cd 



c 

O 

cd 

o 

3 

-o 

UJ 

Id 

a 



C /3 

Un — 

<u 



« O .2P g o b -55 -a o jS ® 

§LE D n cd S ^ ^ — -o •§ 

LZ £ 



ntm\OhOOOvO-*M 

T 3" T 3" T d" T d" T d"^1" , ^"DODODo 



CO 

do 



* 

U 



U 



CO 

g 

> 



o 

A 



GO 

c 



o 

cd 

<D 



u 



u 



co 

g 

> 



c 

o 



1/3 



U 



u 




03 

LO 

*«=< 



O 

ERIC 



GO 

Q 



CO 

<u 

H 



Z 

o 

H 

U 

PJ 

GO 

a 



ON 

CO 

On 

PQ 

cy 

PQ 



I 

U 

< 

UJ 

H 



00 

C 

*5b 

eo j- 

3 f£ 

8 ° 

co X 

^5 .2, 

CO 1 — 
CO <L> 

* 5 
00 ° 
c c 

£ 

S c 

+-* o 
c E 

■S £ 

3 O 

< 3 o 2 



.<L> 

tt3 

O 



o 


c 




CO 




u- 


o 

"CS 




C 

o 


o 
• — > 


<L> 


CO 

CL 




■3 


00 

C 


+-> 

o 


3 

O 




•5 

c 


IE 


c 


o 




o 


o 




o 




o 


CO 


<D 

op 


L- 

<D 




00 

c 


<D 


to 






IE 


T3 

CO 


0> 


o 




u 


X 


t— 

Cl 


T3 


CO 


CO 

<L> 






<L> 


CL 




T3 



<D 

*£ 

CO 

CO 

CO 

CL 

"e 

3 

o 

o 



X 

o 

x> 



O co 

S £ 



£ o 
o o 

nJ CL 



- c 
co a> 

£ > 
3 I 



Y-f f- 

u 5 

4J E 

* E 

!! 

z* 

re 

■g & 

■5 fe 

CT -C 

£5 



^Nor^ooONO^cN 
OOOOO — ~~ 



NO 

On 



CO 



5*2 © 




o- 

-a 

<u 

> 

‘5 

o 

a> 

v- 

3 

O 

>% 

<D 

> 

CO 

XI 

CO 

C 

O 

‘co 

2 8 . 
S «> 

£•1 

O o 
CO 

PQ <-* 

S.o 

a « 




C5 

LD 



CJ 



U 



£ 

o 



<D 



O 

c 

CO 
l— 

<D 

cO 
u. 

iS 

O 

T? ^ 

8> a> 
> 

8 8 
(2 £ 



£ 

° 4> 

E 

o 

<D X 

■° E 

*8 2 

> « 

'5 >i 
o cs 

£ % 
£ u 

§ eg 

a- o 
v o 
•a — 

CO CO 
w CO 

g l 

co <n 
CO 

£ o 

>> Xi 
CO o 

CL 



^ (N cn 
GO 



> 



00 

in 



o 

ERIC 



<N 



C/2 

Q 

M 

-*— * 

oo 

d> 

H 

12 

v 

£ 

r- 

ON 

m 

ON 

CQ 

CQ 



Z 

o 

H 

CJ 

UJ 

C/2 

O 

z 

5c 

u 

< 

w 

E- 



NO 

ON 



m 




CJ 



55 o 

> z 



— <N 



C/2 

g 

> 




CJ 



O- 

W 

H 

< 

Q 

Q 

O 

< 

CD 

O 



C/2 

g 

> 



o- 

E 



O- 

c 

o 



o 

Cl 

00 

c 

LE 

o 

cd 

<1> 



on 

-O 

3 

oo 



t: 

o 



00 

c 

_o 

03 

c 



c 

<D 

Ou 



00 'c 

.5 o 



2 

?? o 
Q- 



0) 



t: ^ 
o — 
-C 

00 HC 



O 5 

00 C/2 

CQ 



00 

c 

o 



<D 00 



t- o 

£ 03 

-O (U 
3 

^ 0) 

3 3 

O .£ 
oo 



c 

o 

u 



O .2 



U 

UJ 

CQ 

< 

cd 

< 

> 



H 

tu 

M 

/ 

H 

X 

uu 

H 

a 



~ UU 
,22 c /2 

"va £“? 
as LQ 



to £ 

E 2 

3 £ 

> O 



UJ 

H 

CQ 

D 

C/2 

ui 

5 

< 

z 

5 



o 

m 



D 

Z 

O' 

< 



CD 

r^a( 



CJ 



I I 

<u a> 

r r 
oo t: 
S o 

O js 
—3 C/2 



~ CN 
C/2 



> 



o 

CD 



er|c 



CD 

cc 



c n 

P 



<L> 

H 



Z 

o 

I— I 

H 
U 
•O W 

E O 

£ £ 

ON 



CO 

ON 

OQ 

CO 



I 

U 

< 

w 

H 



NO 

ON 



CO 



c^- 

X 

o 

00 

c 



<D 

3 



X 

3 

c n 

<D 

E 




fed 

U 



CD g 

e .g 

-3 '*“* 
= 3 

3 & 

f-U P-i 



cs 

GO 



=* 

> 



* 

u 




hJ ^ *0 X x 

w T s 8 ui 

<D J 



S o 
> Z 



^ (N 




GO 



NO 



O- 

a> 

X 

o 

ctf 

CD 

CD 

3 



C/5 V* 



GO 



fed 

U 



ctf 

CD 

>% 



C 
ctf 
X 
■*— * 

c/5 

in 

CD 



ctf 

CD 

>% 



C 

a 



C/5 C/5 C/5 



CT3 

<D 



CT3 

<D 



I— I CO Tj- *T\ , 



r— . (N co dj - no no r-" 

do 



•i. 

> 



Cvj 

CD 



O 

ERIC 






GO 

Q 

•*— » 
CO 

H 

IE 

CD 



Z 

o 

h— < 

H 
U 
W 
c/d 

£ O 



r- 

CN 

m 

On 

CQ 

*5 

CQ 



X 

u 

< 

w 

H 



vo 

ON 



m 



u 

CjJ 

ac 

CJ 



c/d 



Uh 



w 






GO 

w 

£ 



u 



u 



c 

o 



o 

cx 



od ’— 
CX ^ 

C =* 



c^- 

c 

o 

*co 

O 

CX 

OD 

rE 

*c5 

CO 



o 

03 

<D 



ol 

CX 

c 

3 



IE 

E 

cx 

c 

3 

i- 

O 

IE 

'E 

cx 

o3 

_C 

c 

o 

Cl 

co 

O 

IE 

*E 

CO 



CJ 

03 

<D 



O 

rs 

' 2 

cx 

t-J 

w 



Q 

CQ 

o 

E— 

< 

Uh 

T 



03 

CX 

03 



~ W 

.E 

'co 

03 LQ 



3h*'^ 



3 

O 

>% 



co c^* 

O C 

E .2 



03 

T3 CX 

*a j= 

cx £ 



< 

> 



H 

X 

w 

a 



.ti ^ CN 

to 

2 cio 

g 

> 



c^- 

c 

o 

' CO 

o 

cx 



u 



u 



CD 



y-» r- 

E E 

■ j— ; h— » 

— t: 

3 03 

Uh CX 



— (N 
GO 



3 

> 



CO 

V"«jj 



Q .S 



cc 



o 

ERIC 



irv 



i4 

V 



u 



oo 

Q 

M 

t/S 

<D 

H 

2 

CD 



r- 

ON 

CO 

ON 

CO 

C* 

CO 



2 

o 

M 

H 

U 

U4 

on 

0 

5 

1 

u 

< 

UJ 

H 



S o 

> Z 



^ <N 



00 

s 

> 



NO 

ON 



CO 



c^- 

a> 

3 

"c5 

c/a 

<o 

_c 

o 

o3 

<D 



C/a 

03 

"O 

<D 

>% 

O 



C^- Cl 

•1 S 

Ctf <D 



03 

<D 



3 

O 

>% 

<D 

<D 

* 




=tt 

oo 

Q 



<N 



5 S 




* 

u 



u 



o3 

<D 

>% 



kO 
V— < 

<D 


to 

<D 

^ >-N 


o3 

JG 


u. 


c/a 

u. 


c/a 

u* 


c/a 


c/a 

u- 


X> 


P ON 


c/a 


o3 

0) 


o3 

0) 


03 

<L> 


03 

<D 


03 

<D 


E 


g ^ 


c/a 

0> 


So 


So 


So 


So 


So 


3 

2 


> W 






CN 


CO 


^r 


NO 


j* 

UJ 


^ U 
SS 


- 


<N 


CO 




NO 


NO 


cq 


. . oo 


00 













o3 

0> 

>% 



c 

o3 



O 

s 



3 

> 




CD 



CD 

CD 

tH 




VO 



00 

Q 

» 

on 

CD 

H 

12 

o> 



r- 

On 

m 

On 

OQ 

DQ 



z 

o 

H 

U 

an 

C/3 

a 

5 

u 

< 

tu 



VO 

ON 



ro 



c^-* 

-a 

CD 
■*— * 
03 
CD 

o 



■HH 03 



* 

u 



00 

g 

> 



CO 

06 

W 

H 



*TD 

CD 

-a 

c 

03 

a. 

x 

UJ o- 

i ^ 

8.1 

£ o 

M O 

3 8 

"5 

o 

o 

<*> 2 
03 

w i 
s*S 

< H 

> a 



o 

03 

a. 



U 



o 

c 

CD 

to 

03 



CD 

-a 



GO Vj 

•3 2 

CD 03 

-2 to 

X> JO 

-a 

<d 03 
♦-» ^ 
o3 fd 



_ _ 03 

U u u 
a. o. , 

° ° « 
o O W 
• — * r 03 
n JS > 
3 3 ’C 

Q, CL CL 



*TD 

CD __ 

^ -a 
.2 0 

1 1 

* ® 

> v 03 

3 ^ 

.2 3 
tp o 

13 *.§p 

£ 1 

a> 

-c ^ 

0 c 

1 I 

03 03 

•4-J » -4—* 

03 03 

> > 
'CC 'C 
CU CL 



— (N m *r> 

oo 

CjU 

D 

■J 

< 

> 



oo 

C* 

W 

H 



vO 

o' 

vn 

cnT 



U 



X 

H 

Z 

o 

S 

c* 

W 

H 

Z 

X 



c^- 

c 

‘5b 

03 

-O 

c 

o 



oj 



00 

g 

3! 

> 



00 

c* 

X 

H 




> 



05 

CD 



U 



oo 

g 

4 

> 



OO 

X 

H 



cn 

CO 



o 

ERIC 



c/3 

Q 2 



<D 

H 



H 

U 

CQ 

C /3 

O 



r- 

ON 

m 

On 

CQ 

CQ 



2 

U 

< 

CQ 

H 



NO 

ON 



m 

P- 




so 
c 
’ c 

3 

TD 

E 

03 

U. 

SO 

o 



c/D 



H 

CJ 

D 

Q 



UJ 



CM 

ro 



< 

> 



2 

D 

2 

O' 

< 



u 



S o 
> 2 



— CM 



C/3 

CQ 

D 

< 

> 



c/3 

oi 

CQ 

H 




> a 



u 



a. 

'5 



c 

a> 

-a 

3 

•4—* 

C/3 



-a 

o 

4= 

a3 

E 



c 

QJ 

E 

c 

o 

1— 

■> 

c 

a; 

o 

o 






o| M 

| 3 I 

C i- 3 
-*-* u- • — . 

2 3 -O 

£ u < 



(D 

<U 

ft SO 

p o3 

so 

< Q 



— CM 
C/3 



3 

> 



C/3 

C* 

CQ 

H 



o3 

-O 

o 

• *—> 

so 

c 

'Jc 

o 

o3 

<u 



E 



3 

O 

c/) 

03 



ts NO 



u 



U 




C/3 



NO 

ON 

t 

ITN 

ON 

Nn 

ON 

I 

ON 

Pf 

ON 

I 

m 

ON 



CQ 



U 



c 

<D 

t: 

03 

so 

<l> 

-a 

c 



CM 

O 

C/3 

g 

> 






<D 

T3 

03 



so 



<D 

-a 

03 

Urn 

SO C 

^ o 
2 o 
.h <o 

(JL- C/3 



m tt 
o o 



O 

!> 



Q- 

D 

in 

c£ 

CQ 

H 



S3 

ERIC 



7/31/96 B&B:93/97 Field Test IDS 

TEACHING SECTION 



00 

''3* 



<D 

<D T3 o> 

1> "O .. <v> CS -o — 

T3 5 42 “O bx 03 T3 

2 g ^ u ■ 

30 -c eb 00 -a 

■5 t r £ g 



00 



0> 



03 



<L> 

-a 

o3 



a> 

T3 

o3 

u 

!50 



a> 

-a 

o3 

u. 

00 



50 500 






-C 



o f£ .* 



-c ~ 

op .C 



tu £ i/5 go £ Z 



c 

<u 

H 



£ 

<D 

H 



vivOt-OOONO — CNr^^* 
OOOOO — — — — £ 



O 

<N 



oo ! 



03 



* 

u 



u 



GO 

g 

i. 

> 



cn 



ON 

ON 



550 

3 

o3 





*4 

O 



C/3 

s 

> 



CO 

o 

» 

a. 

D 



GO 

C* 

tu 

H 



CM 

v*^ 



O 

ERIC 



• ON 



o 

ERIC 



10 

IN 



U 



U 



co 

O 



CD 

H 

12 

<d 

E 

r- 

ON 

m 

ON 

OQ 

ss 

OQ 



Z 

o 

Hi 

H 

U 

W 

co 

0 

s 

1 

u 

< 

UJ 

H 



VO 

Ov 

i 

to 

ON 

tn 

ON 

I 

ON 

Ov 

i 

m 

ON 



o 

03 

<D 




o3 

C 

o 

£ 

0> 



uj .= 

■*-» 



03 

u- 

o 

c 

a> 

a 



tn 

c 



o 



CO CD 

c *- 

3 



c 

3 

o 

o 

o 

< 



_ CO 

3 <D 

.o c 

t* ' CO 

CO 3 

< CQ 



E 

o 

c 

o 

o 

ta 

CD 

E 

o 

SC 



c 

.2 

*•3 

o3 

O 

•3 

£2 

CO ^ 



CD 

O 

c 

2 

‘5 

co 

CD 

o 

o3 

O- 

GO 

"cd 

o 



5 CD C 

< O ~ 

— • CO "3 T 3 

«t CO c 

o3 
CD 



1 M 



(O 



— o ^ 
= <u 2 

2 f- H 



c 

O 

03 

o 

o 

> 

Un 

CD 



CD 


c 






O 


2 






C 

2 

*5 

co 


0 

CO 

J= 


CD 

O 

C 

2 


CD 

O 

c 


G-« 


tc 


’5 


2 


03 


co 


0 



O 

h C /3 5 

^ w >, Si — 5 

V 3 3 Cd E 

“ c O .2 o-.w «2 

— 5 "5 « E !" •£ 

.2 -c 2 o js' .5 

fflua£u £2 



CD 

O 

C 

2 

*5 

CO 

Un 

CD C 

£ 2 

o £ 

03 3 

-O "O 

c UJ 

03 __ 

. — 03 

o3 o 



c 

o 

’■3 

03 

O 

3 

T3 

uj 

*13 

CO 35 
<D ^3 
00 « 
3 E 

3 CD 

o3 n3 

C £ 

,2P « 

CD S3 

O 2 
V5 CO 



co 

c 

’C 

0} 

(D 



CD 



CO 



C .3 



a> — _ 

a cq E 



E c -c 

o3 aj co 

E C *55 'E 

• — co 03 co 

<D m 3 n ^ 3 

O hJ C*C CO O CQ 



O 

T3 

1— 

c3 

pC 

-o 

c 

03 



53 .2 ^ 

03 

CD 

a 



T3 

<D 

■e 

3 

to 

-5 

j>^ 

*2 

c 

.2 

o 

E 

UJ 



— (NmTtu^vor-oo^o 

OOOOOOOOO^ 

CO 



Mn^in\OhoooNO^ cNm^f^Nvor^oooN 



4 

> 



VO 

ON 



m 



a. 

D 

CO 

QC 

UJ 

H 



J> 



o 

vn 



O 

<N 



pq 




fN» 



CO 

Q 



CD 



o 

1—4 

E- 

U 

T3 W 
» 00 
E O 
Z 

1—4 

X 
u 
< 
pu 
H 



r- 

ON 

m 

ON 

CQ 

CQ 



-o 

CD 
Oh 
Oh 

o3 
O 

T3 1 
<D E 
a, 2 

CL J= 
o3 >% 

o =0 

cG 

C .2 
03 ~o 
-c cd 

^ c 1 - 

o 

C T) X 

“ ts 

oSSo 



-o 

CD 

<ts 



-o 

<D 
T3 

2 — 
aJ 



03 



— £ 
U W 

£'•5 

o3 00 
.2 C 
T 3 *5 

E E 

03 03 
-C jd 

^ o 

2 s 

<D o 

> <u 

<D CL 
C/3 C/3 



-o 

V 

u- 

E 

CL 

E 

<D 

00 

a3 

3 

00 

c 

03 

o 

CD 

<D 

CL 

C/3 



<D 
C 
CD 

oo 

cf 
o 

03 

o 

a 

"O 

pq 

>, z_, 



-o 

cd 

cx 

CL 

o3 

CD 

c 

03 



CD 

00 

oS 

3 

00 



2—5 

£ T3 ^ 



2 
’5 
<u , 

CL 

CO ( 



a 

<D 

CL 

c/3 



T3 

C 

o 

o 

<D 

c/3 

o3 

c/3 

03 



c/3 

’ob 

c 

PQ 



CD 

00 

03 

3 

00 

c 

03 

U 

-r: 

2 

3 b 

c 

PQ 



E 

^ op 

03 
C 



CD 

O 

c 

‘o 

CO 

*2 

o 

o 

CO 

CD 



T3 

03 

aL 



0^(Nnt»nvOhooONO^Mn 

mmmmmmmmmmrtrtrrrr 



c 

o3 


-3 

CL 


c 


3 

£3 


CD 


O 


o 


U« 

<D 


on 

_C 


’5) 


/2 

‘5 


C 


IE 




o 




CL 




CO 




tn 


VO 


r- 


rr 









CD 

o 

c 

o3 

Q 



03 

CD 

~c 

'E 

E 

03 



C 

.2 

13 

o 

3 

-o 

PU </3 

^ U 
-3 CD 
03 

s 

C/3 O 
><* — 

£3 



OO ON O —« CN m 
tf t ^ m 



VO 

ON 



m 




ITERS: Once for each VALUES: CHECK: 

field 



2 

O 

H 

U 

tu 

C/D 



00 

Q 

on 

cd 
H 

12 

<D 

£ O 

£ 2 
ON 

m 
OS 

CO 
CQ 



I 

U 

< 

tu 

H 



S 3 

ERIC 



(N 



c 

0) 



h 



% 



— ° t" 
it-. 2 2 
_ “ D 2 

J o «= U 

•Sa|§ 

° & I .E 



u 



Cd 



D o 
>- 2 



(N 



oo 

B 

> 



vO 

On 



cn 



Q_ 

D 

00 

o£ 

W 

H 



cu 



00 



oC 

O 

tu 



oo 

Q 

tU 



N-l 

tu 



3 

> 



3 




O 




>% 








<d 




,<D 

C 4 — < 




3 




O 

>% 


o- 

JZ 




O 


cd 


cd 


_C 


CD 




■*— * 


00 


O 


C 




2 c 


T3 


CD 


<D 


cd 

CD 


w~ 

cd 

O- 


3 


<D 

u- 


O 


Q. 










<D 


<D 


v_ 


4 —* 


<D 


cd 




3 

3“ 


CD 


(D 


u> 


*a 


cd 


cd 






on 


0 


-O 


c 


O 


^ ^ 




0 

u- 


• 4 — » 


O 


cd 





J £ 
£ e 



cd 

H w 

X 

tu 

H 

a 



vO 

m 

CU 

a 

a. 

o 

2 



TT 

TT 

m 



> 



a 

< 



05 

IN 



u 

u 



s 



u 



cd 

<*-* 

c 

<D 

E 

QJ 



0) 

c 

a> 

a 



oo 

c 

a> 

u. 

Cd 



00 <D 

C ‘ 



UU .b 3 



c 

3 

O 

o 

cd 

< 



op 3 

< QQ 



cd 

<D 

2 



E 

o 

c 

o 

o 

tu 

<D 

E 

o 

X 



c 

.2 

o 

3 



cd 



d) 

CD 

C TD 

CD C 

o 'Z* 

™ 73 "2 
h.H § 

cd E cd 
2 o -2 

• — <D & 



CD 

a 
c 

2 
’5 

on 

*5 



22 cd 
^ c 



CD ^ 



SB 

o 

o 



CD 

o 

c 

2 

'5 

oo 

CD 

u 

cd 

a. 

oo 

"a? 

o 

c 

2 

o 

00 



C 

cd 

On 

22 oo ^ 

c o .2 

« o > 

<D 



CD 

a 

c 

.2 

o 

oo 

u. 

<D 



<D 

O 

c 

.2 

'5 

oo 



2 h h o S u a 



-j cd C 
Fv CD CD 

p 35 ■£ 
O ^ * 
U Om S 



<D 

o 

c 

CD 



2 c 

•£ .o 

o 15 

15 § 

-rj 

c UU 

cd 

. — , cd 

fe » | 

c 5 c 
§ = £ 
O CO tu 



^-cMm^ru^vor-oo^o 

ooooooooo^- 



M^TfinvOhOO^O^ 



OO 



3 

> 



ro 




O 


00 


Q_ 


£n» 


D 




00 




0 ^ 




tu 


» 


H 





7/3 1/96 B&B:93/97 Field Test IDS 

TEACHING SECTION 



C 

O 

c 5 

o 

3 

-o 

UJ 

00 :-G 

QJ T3 

so 2 

S E 

3 <d 

get 

oS ~o 
G £ 



O 3 — 



SO 

c 

*5 -a 

OS (L) 
QJ o 

t: 

O co 

-o 

u. 
as 
-G 



C 

as 



CO 



E e co c qj 

Jr; '*3 2 ^ 

U eS 3 Q. ~ 

O Jc^wO 



GO 

CD 

CO 

as 

CQ 



-a 

>% 



T3 

QJ 

-a 



aS 

C 

o 

•- -a 

o £ 
E € 

m a 



T3 

qj 
a. 
a. 

_ as 

as .2 

"5 *2 
>— c 

C 'O 

CD T 3 

s s 



-a 

QJ 

a. 

a. 

aS 

cd 

'-5 

c 

as 



-a 
qj 
Cl 
CL 
aS 



co 

QJ 



aS 

co 



-a 

CD 



T3 .3 



as 

a- -o 

E flJ 

a. 



aS 

Q 

‘-5 

qj 

Cl 

O 

-C 

t: 

O 



aS 



qj 



CD — 

P IG -E S 3 as 



“53 

qj 

> 

CD 

GO 



CD 

GG 

"o 

CD 

Q. 

GO 



op g 

CC • — 

GO C 

C 

>% 



as 

u- 

c <= 

5 .2 

00 3 

c « 

.2 T3 

t3 w 

cj 



QJ 

GO 

as 

3 

GO 

C 



55 



aS 



3 

T3 

UJ 



QJ 3 
<U Jo 

CO > 



2 

’5 QJ 
QJ 4 = 

a. x 

go O 



2 ^ 
o 

QJ 
Q. 

co 



QJ 

GO 
as 
3 
GO 
C 

CO 2 

aS 



co co 

’so "so 
c c 
UJ UJ I 



E 

CO 

"c 3 

c 



-o 

3 

GO 

C 

aS 

CD 

* C 
QJ 



QJ 

> 



.2 

'”5 



GO 

C 

'’B 

as 

QJ 



C -c 



QJ 

CD 

c 

QJ 

‘5 

GO 

~2 

'o 

o 

GO 



CD 



• C | 

o , 
^Gp . 

"qj 
O' I 



csmTj-tnvor^ooaNO^cNmTrmvor^ooaNO^cNfOTS-u^vor^oo 

MMMMMMMMnronnnnronnro , Q-Tt'^TfTS-TtTt , Q-Tf 






o 

GO 

tL 



o 

ERLC 



49 Dance 

50 Drama/Theater 

51 Music 

52 Physical Education 

53 All others 



C/D 

Q 

C/3 

<D 

H 

12 

0) 

£ 

r- 

ON 

m 

On 

CQ 

cy 

CQ 



Z 

o 

H 

U 

w 

c/D 

O 



K 

U 

< 

UJ 

H 



NO 

On 



m 




CD 

E 

V 

tc 

cd 

a. 

w 

O 

O 

E 



<2 

Ui 

O 

£ 

O £ 

rri T3 





NO 

ON 

1 




E-> 






ON 




$ 


On 


o* 


6; 


i 


2 


-J 


On 

On 


u 

C/D 


Uh 


m 






On 




j' 




z 


UJ 


C 


< 


3 


H 


"cd 




X 

UJ 

H 





> a 



u 



(D CD 

6 .g 

i £ 

Uu 0u 



^ <N 
GO 



> 



a. 

D 

GO 

oC 

uj 

H 



o- 

(D 

E 



S 



u 

B 

u 



GO 

s 

> 



CL 

D 

GO 

aC 

UJ 

H 



cd o 
> Z 



<N 



O cd 
<D <D 






— * O 



a 



00 

03 

tH 



i4 

u 



C/3 

0> 

>< 



3 

C/3 
■*— * 
o 
Z 



. — . cn m 
GO 



4 

> 



CNJ 

00 



o 

ERIC 






10 

CO 



vO 

Ov 



co 



E 

cd 

CJO 

o 



03 

.2 C/3 

e 

(D cd 
1/3 bk 
* W) 
.£ o 



co 

on £ 

If 

cd .Si 

'5 fc 

3 S 

on 
cd 



on c_> 
CXi * it 

2 & 
-C <d 

J2 ? 

u C 

o — 

£ o 



p , co 
03 

0) CO 



3 

O 

O 

c 

o 



"O 

03 



u. cd 
O O 

CO 3 

a. y 
o ^ 



2 

<u 



cd 

c 

o 

cd 

o 

o 

> 



>v O 

•° s 

-a .s 

S - 

§ 12 



o 

a. ♦ 

CO 



O 

C J3 3 

o *t£ -o 

CL o «* 
H * 



o-g 



H 

on 



o 

c 

o 

*53 

c 

a> 



Q & 8 
J J 
O O w 

o o b 

is > 

U U C 

c/3 on [D 



o 
ao on 

j?.2 

3 -r 

CO < > 

u. *4-» 

3 £ 
O ^ 
>% -C 

•£ % 
on O 
03 u 
on 00 

3 13 
o c 
<-> o 

d-> ’co 
00 CO 
& 



U cu 



E 

a> 

T3 <13 
cd 03 

s .s 

03 E 

td E 

& 3 

03 ~ 

.i J 

3 

O 



03 

03 



03 



E 
E 

O ic 

O O 



CO 

.5 

03 

•4— • 

cd 

E 



CO 

-X 

O 

O 

-g 

X 

03 

oo 

.E 

* 

o 

JD 

03 

on 

c 

o 

03 

03 



E 

E 

o 

U 



O 



on 

03 O 



— <N 



OO 

UD 

D 



> 



U 



03 

on 

3 

ob 

03 

c 

_o 
1— * 
o 

H 

to 

.E 

u. 

£ 

>v 

00 

o 

o 

c 

_C 

o 

03 

15 

c 

.2 

cd 

o 

3 

”0 

03 



00 



12 

03 

« 2 
tJ ^ 

03 tn 

15^ 

3 

on 



C 

o 

-4—* 

cd 

J3 

cd 

> 

03 

00 

.E 

V- * 
co 
03 

Lm 

O 

CO 

-o 

O 



03 



*S 3 3 

S O « 

03 

III 

ZZZ r-- 

03 O .E 

cd 03 ^ 
cfl 4-» T! 



co 

03 

on 



on 

LT 
03 
td co 

3 

a. o 



3 

+-> 

co 



03 



a. 

03 

TD 

» 

c 



E 
o 
o 

u 

co 

CO 

— -2 

$3 3 

E o| 

oi) O C 

' E — 

S5 00 

4 -» CO C 
C 03 • = 
03 CO C 
C CO U; 

E cd cd 

on 03 

on 03 — 
03 O ^ 

on c ^ 
c£ cd .X 

“ E 13 

Cow 

s € §- 

2 8. o 

u 



03 



on 

03 



o 

Z 



co 



— <N 

GO 

§ 



> 



Ui 



O 

ERIC 






oo 

Q 



Z 

o 

H 

U 

w 

oo 



<d 

H 

12 
a> 

E O 

r- 

ON 



ro 

ON 



NO 

ON 



CO 



<N 



X 

o 

« w 
cy ^ 

CO 




D 

C/3 

a> 

jz 



a 

C/3 

<D 




<N 



00 



O 



U 



c 

.2 

o 

2 

« 2 
c a> 

T « 



SB 



o 

c 



o 

CD 



2 

O <D 

.a> tx 
.o' «-* 
3 o 

s <1> 

a 3 

o 

>% w- 

? l 



03 

C -C _ 

° 2 •- 
• — • 03 . 

33 <d >> 

S — T3 
3 ^ 3 

•a ° t« 
a> <5 _c 

^ ^ *5 
O g c 1 - 

r . -S <D 
a> a> 

dS = 



o 

o 



c /3 



<d 



&D 

if 

E £ 

on <L) 

C/3 

<D <n 
% > 
* ts 

c fe 
a> o- 

2 o 
00 CJ 



, M Tj - l/N 

00 

B 

1 

> 



03 



GO 



U 



a 

TD 

<D 

X3 

o 

C/3 

u. 

3 

O 

>% 



^ C/3 



00 3 
.£ 

2 <L> 

o c 

03 E 
<U 'X 
•*— * 

s S 

O w 
<+Z CD 

I 'I 

*T3 
<JD 3 

-a 

CD 



C 

<D 

Q- 

X 

CD 

E 

<D 



T3 

CD 



03 



2 x: 
a> o 

Od ^ 



•? s 

fc cb 
a- u 
w - O 

*2 -a 

T? C 
C «3 
03 c 

« .2 

s| 

(- H 



I 2 

o o 

&•§ 

•« « 
c •£ 
o «r 



£ g 

2 § 

cu Z 



CN m ^ nt> no 



oo 

B 

* 

> 



CO 

CO 



0 

ERIC 



vO 



U 



u 



u 



C/0 

Q 



C/5 

<D 

H 



Z 

o 

H 
U 
T3 W 
« ^ 
£ O 

r- *” 

On 



m 

ON 

PQ 

PQ 



s 

u 

< 

w 

H 



$ o o 
> Z Z 



CTJ 

^ .£ 
03 '-O 

Ou )r 

•” 8 



c 

3 

O 

O 

C/5 

‘5b 



o 

.S O 

CL E 

— 4-- 3 

03 “ 

Q- 
O 
C 



^ E 



* .2 

o 

c j= 

~ u 

F >> 

<3J c/5 

a. 

£ "o -c 
2* o <-> 

CL f- 03 
<D •** 



§ 

a 

o 

GO 

H 

X 



s 



u» 

N- 4 

u 

w 

cu 

C/3 

u 

0> 



£ < u Q w O 



o O ts 



o 
O Z 



cG o 

> z 



cn cn 



GO 



p-Mnt^\Ohoo 

GO 



<D 



— CN 
GO 



> a 



i 

> 



4 

> 



i. 

> 



VO 

ON 



a 



m 



CO 



00 

CO 




r- 

in 



c n 

Q 



<L> 

H 



r- 

ON 



Z 

o 

H 

U 

w 

on 

o 



m 

on 



X 
u 

g w 



NO 

ON 



CO 

O 
•— > 

O 



* 

u 



co 

s 

> 



Z 

o 

c 

p* 

- 4-4 

~e 

o 

T3 

• 4 —* 

3 

X) 



00 

c 



S O o 

£ Z X 



CN ro 



UJ 

O 



a, 

5 

CO 



o- 

oo 

c 

IE 

o 

cd 

d 

■ 4—4 

a> 

3 

CO 

t- 

3 

a. 



o 

c 

T3 

CD 

33 

O 

CD 

33 



a 

z 

x 

u 

< s 

LU <d 

H 



3 

O 

c 

o 



H 

Uu 

UJ 



cd 

E 



a. 
a> 

I -5 

co 

cd 

*J £ 
UJ ^ 



H 

aC uj 

< H 

> a 



x 

u 

< 

LU 

H 

X 

tu 

^ ro 

ui 

5 * 
< 
z 
c* 

< 

> 



Op 



u 



u 



D 

z 

a 

< 



CO 



CD 



O 



<2 



cd 

O 

U< 

CD 

X 

cd 

E 

<D 

E 

o 

X 



CO 

UJ 

D 

> 



33 

D 

C 

00 

* CO 
CO 

cd 



C 

D 

T3 

3 



C £ 

.2 £ ^ 
+-* a> w- 

1 g<s 

O 

0*0- = 
m £ § 
.E >e 
.* c o 
£ 2 °- 
§ "3 g- 

> CO O 



X 




X 


X 


X 










I 


I 




i 




c 




c 


c 


c 


2 




2 


2 


2 


'3 




’3 


*3 


*3 


o 




u 


o 


u 


>? ciH 








ciH 


c 2 




CO 


CO 


CO 


1 « 




■3 


* i- 


’-3 




cd 


cd 


cd 


E_ co 


X 


CO 


CO 


CO 


00 co 


o 


CO 


CO 


CO 


CD X 
w- Q 

a- w 


cd 

D 

-4—4 


5 


5 


5 


<N 




m 


^r 




O 




O 


o 


o 



CD 

P* 

1— 

0 

5 

1 

o 

o 



s-f 

o ^ 

v~ c 

00 o 

g ■§ 
o c2 

• *-< co 
co • — 

CO +* 

<2 S 

o .2 
a. Q 



00 

CD 

C 

CD 

£ C 

-5 .2 

33 

C 03 

s 8 

4) -=* 

•if .i c 

o «• 2 
? x> eSJ 

60.0 S 

• S DD^ 

00 C «# 
|| 2 
15 52 op 
-f= £ .S 

o <u > 

D 33 O 

Jr w E 

O co c 
P <D h* 
C — O 
3 3- 

D D N? 



D 

3 

C 

■3 

C 

o 

o 

• 4 —* 

o 

c 

c 

cd 

o 

$2 

o 

33 

'c5 

X 

o 

• ’ — ) 

00 

c 

jE 

o 

cd 

a> 



c 

.2 

’- 4—4 

Cd 



co 

C 

o _ 

co 33 
cd C 
4> 3 



O 

Pi c 

ctf c 

<- ^ <D cd 



D 

C C > 

cd cd o 



, CO 

o ’E 
x E 

a *5 

2 o 

PC c 
a •— 
cd a) 

X) > 

oo 2 
c E 
o °-£ 
Oho 



<D 



^OhOOONO^Mn't 
OOOO — — — — — 



o 

03 




CO 

CD 



oo 



VO 

ON 



m 




U 



u 



m 



c 

D 

O 

D 

U 

>% 

X) 

-o 

D 

oo 

3 

oo 

D 

‘5b 

D 



03 

D 

CO 



50 
C 
+— » 
d 
50 

<+H 

O 



3 

CO 

D 

U- 

c3 

oo 

c3 

oo*' 

-O 

D 

50 

C 

<3 o. 

O S 

u- t- 

o g> 

-O 33 



C 

D 



■2. E 

<U 



C3 



c3 
C 

_ .o 
■5 -a 

_S co 



CD 



1-1 



<a 

O 



33 


D 


o a 






D 


33 


u 






CO 


C 


CX O 






D 

u 

D 


<43 

O 


E <d 
2 «8 


00 

D 


O 


-*— < 
C 


00 


"c3 -o 


> 


z 


D 


D 


3 2 






i— 


*c3 


o ,0 






~D 


3 




(N 


3> 


33 


u- 






> 



*4 

O 



d 

u 

e 

o 

co C 

c 2 
.2 E 

< 4 _> D CO 

U 3 
O j 3 C 3 

0,0.- 
CX _Q c3 
^ O £ 

CO ' 

(U «0 -C 
3 2 50 
2 Q. ^ co 
P C o T3 
ix C 

O *£ .2 



X) 

<43 



CD 

| S 

c I 

2 CD 

E 50 

>% 

.2 ~ 

cx S 

I g. 

H 

J= E 

*-* CD 



,« c 



00-* u 

c ^ 

•5 O 



E 

CD c3 



3 

O _ 

c 5 

D 

GO 



0 3 ^ 
~ CD -o 
-* D 
O 

O co 

Jj < 



u- > 

o *5 > 

co rj , 
_>n g O X) 
35 c2 <D X) 

E gi £ 
<5 a.13 .2 
•o -o "2 © 

<U <L> £ > 

-* .* £ -a 
co co 2 .5 

< < < Q 



45 <u 

3 D 4 -» 

u c 
03 5 

O £ 
33 
_Q c3 

- CD 



C 33 
O c3 
CD 



°2- 



c3 



33 
ID 
33 tj 
D 2 

O C 

o o 

-J u 



c 

c3 

£ 

c3 



co __ 

CO ^3 
,D 

X-« O 
O c3 

cx 0- 



^Mn^tmvohooovo 

OOOOOOOOO — 



go 

w 

D 

i 

> 



O 

ERIC 



CM 

o 



12 Subscribed to trade/professional journals 

13 Attended professional meetings 

14 Nothing 

1 5 Other (SPECIFY IN NEXT SCREEN) 



7/31/96 B&B:93/97 Field Test IDS 

EMPLOYMENT SECTION 



ON 

NT) 



o 

ERIC 



ON 

ON 



00 

c 



U 



00 



3 

> 



ON 

ON 



o 



<D 

csi 



JO 

O 



o 

o 



B 

£ 

< 4-1 



T3 

<D 






u 



GO 



4 

> 



NO 

ON 



cn 

ON 



<N 



u 



c n 
W 
D 



NO 

ON 



ON 



(N 



00 



C^- 

0 S) 



o 

o 



U 



00 



3 

> 



*0 

v=H 



*5 

U 



<D 

> 

03 



3 <2 



§ 



S o 
> Z 



CN 



00 



tH 



7/31/96 B&B:93/97 Field Test IDS 

EMPLOYMENT SECTION 



O 

VO 



__ - — » 

— 



e 



CO 



W CC 



Q- •- 



u 



u 



8 3 
> 2 



— CN 
CO 

s 

nJ 

< 

> 



u 



U 



CO 



3 

> 



o- 


CO 


CO 

h* 


<D 




co 




a> 


O c- 


<D 


CL £ 


c 


E ^ 


o 


<L> ^ 




, o 


c 


<D Q.. 


c3 


5 E 


u. 

,o 


O <D 




<D i- 


-o 


co <D 


<D 


O -C 




r- *-* 

-S o 


o 


"ui <u 
QJ co 






*4 

U 



U 



CO 



■i 

> 



r- 

05 



cu 

O 

O 



w 



r- 



a 

< 








CD 

05 



t 




NO 

ON 



m 



* 

U 



co 

g 

> 



NO 

ON 



o 



NO C 



. . o 



CN 



.y o 




u 



co 

s 

<< 

> 



CO 

o£ 

W 

H 




T3 

<U 

T3 

C 

CD 

X) 

o 




* 

U 



CO 

g 

> 



CO 

c£ 

LU 

H 




U 



CD 

CD 



<u y 

E J 

s t; 

d «» 

cu Ph 



^-4 (N 

co 



4 

> 



QO 

CD 



CO 

c* 

UJ 

H 




7/31/96 B&B:93/97 Field Test IDS 

EMPLOYMENT SECTION 



<N 

VO 



4> 

E 



<x 2 



2 


g 


u 


!! aa j 

II A k J 




u 

fTl 




u 


j| “X 2 


u 


B 


5 


a 


II u o 


i 


u 


• ; O 

X H 


u 


II lii H ^ 


u 



S o 

> z 



—I (N 



c o 

§ 

4 

> 



CD 

d 

X 

H 




x 



D 

> 



CO 

g 

> 



o 

z 



<N 



C/3 

oC 

u 

b 



§ 7 
o m 



cc 

d 

c 

D 

-O 

c 

d 



>3 

o 



d 

c 

3 

00 

C 



d 

a 

CD 

V— < 

3 

O 

>■* 

CD 

Un 

CD 

£ 

cd" 

E 





CO 

<D 

>< 



O 

Z 



00 

g 

> 



<N 



GO 



,0 • = 



IX. 



o 

CJ 



u 



u 



t: 

3 



00 

c 



D 






Xi 

i— 


E 






O 






C/3 

D 


£ 


* 






o 


<2 


O 


"E 






£ 


IS 


D 


o 




’ co 


X) 


o 


o 


a 


03 


-C 


>— * 


o 


C 


CD 

CO 

O 


c 

03 

£ 


Q. 

C/3 

D 

L- 


3 

"E 


00 


-♦— * 


*>-y 


o 


c 


"c 


• 3 


’ CO 


’5 

O 


TD 


E 


>% 


Q 


03 

X 


•C 

X 


<N 


m 


"sT 


vn 



"O 

p D 
. 1 = > 
'♦r? a3 
D u- 

H 



GO 

g 

4 

> 



GO 

0^ 




§ * 


CO 

Pi 


o 


X 




< O' 


X 


O 


H 




> < 


H 


ca 



O 

ERIC 



m 

\Q 



\Q 

On 



m 




CO 

o 

(Ni 



fed 

u 



o 



, — ,(Nn^'n\OhooO\'- 




[U w w 

< < < 

in 



* 

> 



CM 

O 

CM 



O 

ERIC 



IO 

CM 



VO 



VO 

ON 



cn 



O 

ERIC 



U 




o 

<D 



O 

o 



cd 



<T) O 

>- Z 



— 04 



C/3 

s 

> 




.a o 




54 

U 



n 3 ^ 

u d u 



oo 

UJ 

D 



o 

On 

m 



< a 
> < 



.« .o 

s So 




c 

c3 4-» 
CJ cd 
. . O 
>H T3 

3 
O 

Vi ^ 

yl 

t? T3 







*4 

u 



C/3 

g 

> 



© 

04 



7/3 1/96 B&B: 93/97 Field Test IDS 

EMPLOYMENT SECTION 



vr> 

VO 



..It 

ui g So 

O 3 .5 

Z o* 

r2 -C (U 

a H ^ 

cu 

2 

GO 



cd 

& 



u 



cd 

o 

U* 

JU 

o 

tf 

o 

CX 

a. 

3 

C/5 

<D ' 

> < 



<U 

> 

3 

O 

<D 

X 

UU 



— cd 
cd c 
*C O 

& *55 
dp co 

G *4-« 
cd O 



o 

<L> 

H 



E 

-o 

< 



o 

<D 

CX 

c/5 



<D 

JZ 



ph m n ^ vo h 
GO 



> 




u 



U-4 o 

2 S. 

£ = 
<2 S 



C 

<D 

E 

c 



g c 

> u- 

o « 

dQ > 



c 

<D 

E -o 

C <D 
Jr 

> -2 

o a. 



a> aj Id do 00 E 

cd ? <u ^ cd ,i 

> t T3 S £ £ 

*C *- <u 4-* o a> 

Oh cu UU GO J GO 



^ CM m Tt VO 
GO 



4 

> 



£> 

O 

CM 



cu 



u 



C/5 

,<P 



T3 

c 

a> 



C/l 

4) 



G 

3 



E is 



-O 

T3 T3 
<D cd 

U-i 

Ju 5 
*8 £ 
cC > 



O O 

GO 



a> 

o 

E 


ts 

o 

cx 


o 


CL 




o 


c 




<u 

E 


o 


<L> 


!s * 

.g aS 


G> 

cd 


a. 


*K *> 

«« c 


X) 


o 5 


o 


ex -*-* 

c 


• ' i 


T3 -5 


C/5 

3 

CL 


g -C 

o «> 


E 


CL o 


cd 


X «- 


u 


W ■£ 


CO 


^r 


o 


o 



* 

> 



CO 

o 

CM 



ERiC 



a* 

o 

CM 



VO 

VO 




o 



VO 

O 



r^ooovo — (Nm^ 
ooo<— — — 



vo 

Ov 



m 




>d 

<J 



<J 



<N 



c/a 



> 



a) 

o 

03 




7/3 1/96 B&B 93/97 Field Test IDS 

EMPLOYMENT SECTION 



no 



CL CL 




O 

O 



* 

o 



U 



cd 



oo 



nJ 

< 

> 



On 

On 

ON 

ON 

On 

On 

On 

On 

On 



U 



u 




(/) 

<D 

CO 

3 

C 

O 

x> 



co 

CL 



w 

C 

o 

* co 
co 





E 


L. 










E 


13 

O 


>> 

cd 

-a 


0) 

<L> 


c 

o 


o- 

u. 


o 

o 


JE 




£ 


cd 

<D 


c 

cd 


<u 

CL 


i— 

<u 

CL 


<u 

CL 


<D 

CL 



cd 

<D 



£ u 5- « 
S t < 8 






in 

g 

* 

> 



o 

CV2 



O 

ERIC 



7/3 1/96 B&B: 93/97 Field Test IDS 

EMPLOYMENT SECTION 



00 

VO 



O 

<D 



cu 

2 

m 



cc 



< 

at 

W 

cu 

on 

OQ 

O 



<D 

Cl 



m 

OQ 

O 



cc 

E 



« § 

>> 

J 3 "O 
£ '1 

H © s 

U-) >, JC 



§ 



00 



. H 

d X 
ot uj 
< H 

> a 



*6 

o 

X 

CJ 

OQ 




U 



u 



C/3 

<u 

>- 



o 

z 



— <N 

c/i 



J 

< 

> 



UJ 

a .. 

Z CL 

S u 

CC co 



12 

a> 



03 

3 

T3 

03 



C 3 <D 

O C 
2 § 
00 U. 

« 3 

^ O 

-a >> 
g o 

J 3 J 3 
O O 

C c/a 

(U •£ 
QJ *ZI 



■O « 

. 9 - c 3 

x: “ 

CO 

C 
O 
-3 
-2 



<u 



-J 

uu 

OQ 

< 

nJ 

c* 



<L> 

C/3 

u 

? C- 

° ZT' 

X ^ 

H 
X 



C/3 



UJ 
H 

> a 



H 

U 






OQ 

ui 



< 

> 



D 

Z 

a 

< 



u 



u 



cC 

JZ 

>> z 



<D 

E 
o 
Cj m 



<D 

C/3 

O 



03 

cS 

o 

Z 



— <N m 
CO 

s 

> 




o- 

X 

o 

22 

IE 



*4 

U 



CJ 



S o 

z 



— <N 



GO 

s 

> 



oq 

O 



cu 

2 

C/3 



cC 



CO 

03 



u 



u 



a> o 
JH Z 



— <N 



m 

g 

i. 

> 



> 




07 

v-4 

OsJ 



on 

vO 




o 

ON 



m 



&4 

U 



U 



c 



Cu cu 


O 

E 




J X 
W ^ 
oa 


o 

u, 

CL 




< H 


cd 


ua 


d X 




D 


IX w 

<3 H 
> a 




> 



S O 

^ z 



*4 

U 



u 




qj t- z: 

5 5 ' ? ? o 

.C TD ? E ^ 

i_U. 1 -.l_L- 

<U <U <D <U 

Cu Cu CL Cu Cu 



, — (N n ^ wn 






CO 

UJ 

D 

* 

> 



ITJ gm 

•= cu 



yH 

OJ 



*4 

U 



u 



"O 

c 

x 

2 

3 

O 

o 



cd 

<U 

u. 

cd 

<U 



CD 

O 

c 

cu 

rti t- 

CL +- 

X «« 

O o 

O - 
£ 



E 
o 

C/5 O 

=3 E 
■ .2 ^ 
^ > o 
c fi o 
O ou O 



X) 

o 



<D 

<D 

u 

cd 

o 

L- 

<u 

> 

o 

.m 

c 

CD 

-*-» 

O 

CL 

U 

E 

o 

o 

c 

T 3 

O 

O 

O 



c 

<D 

E 

CD 

O 

c 

cd 

> 

-a 

cd 



C 

3 

C 

O 

tn cl 



3 o 

CD U. 

on cu 



X 

O 



o 

£ 

03 

c/a 

•£ .2 
o ^ 
£ *3 

^ (U 

■all 

1 = 1 

s »=§ 2 

fr -*— > X cd 

« S “ E 
1 fc = o 

15 *-» cd '*“* 

«SSE 
• 2 ? « •§ 
S « 8 



CL 

o 

<D 

CL 



C 

o 

o 

cd 

(U 

» 

c 



— cNm^vnvor^'OOONO 

ooooooooo — 

on’ 

UJ 

D 

j 

< 

> 



v - t *1 

CM 



O 

ERLC ; 



o 



c- 

V‘M 




\o 

ON 



co 



O 

ERIC 



U 



u 



^ c 

P <D 

S £ o 
o o a- 
CL P- fc 

s fe se 

<U cd 

U Jd o 

3 Sx 

D 2 § 

.tJ JD C 

£ *55 

0— cn 

j? O o 

Q <x Z 



— (N n 



C/3 

g 

> 



«D 

2 

D 




O 



u 



D o 

> z 



CN 



00 

g 

> 



£ 3 £ 



w 



>* 

cd 

CL 

D 

X 

H 



CO 

vH 

CNJ 



CJ 



x> 

o 

u 

3 

O 



a; 

C >0 

c 

JD 

cd </) 

C 

U o 

*T 3 *5 

£ £ -td 

<rr ^ C 
0> <D O 
coo 
o S &o 

- 0 2 C 

&l? 

C 8- o 
<h M Z 

<u (U <u 
-C -C -C 

H H H 



c 

o 



1 '§ 
t: g 
o 55 

it 



c 

o 

£ S 

5 o 

u T 3 

0 o 

? *- 

1 o 

o jc 
o t: 

£ <2 

*<2 
V 3 T. 
Q, >n 

o ^ *E 
.2 £ § 
£ o C 
u '5 o 
o cd a. 

3 g- 

t/j w- O 



3 3 3 3 3 
O O O O O 
> > > > > 



-o 

<u 

<+3 

c /3 

T3 cd 
a> <*> 

nr . r ^3 
T 8 cd « 
•n £ 
td •§ .22 
^ | e 3 

b E S 
o o -j2 
> c /3 Q 



- (N n 



CD 



NO 

ON 



3 

> 



an 

CM 



ERJC 

hfflinaffamiaaa 



219 



<N 

r- 



vo 

ON 



m 




c 


(N 


Cd _0 

E o 


<4-H 


^ 00 


5 


c .s 

° JC 


2 


-*5 y 


H 1 


co od 
<D <D 


£ 






CT co 


O 


.2 Z 


o 


fS .2. 


H 



MM 

Q 

a“ 



00 



Im 

o 


cs 


£ 


•*— » 
3 


CN 


O 


>— 1 1 


T3 


4—* 


C 


co 

a 


CS 




O 


c 


•*— » 


• “ 


<D 


to 


c 


US 


*E 


~a 


’£ 


*-<u 



cd 



<u 



CO 



* a> 






<L> 



c 



64 

U 



U 



CO 

<D 

> 



O 

Z 



— CM 

on 



3 

> 



<L> 



u 



u 



c n 

s 

i 

> 



*4 

C/3 



tO 

C 



<D O 
> >< 
° J 

° s 

tO t 



515 



to 

o 



c 

d> 
-*— * 
c 
o 
U 

_i 

UJ 

OQ 

< 

J 

C 4 

< 



S £ 

h < 

£ X 
£ H 

n — j 

° d 
>> < 

w 



T3 

S 

H 
X 
UJ 
H 

> a 



Q 

O 

u 



z 

o 

u 

z 

cC 

H 

i m 

< 

z 

cC 

< 

> 



m 

^r 



D 

Z 

a 

< 



C,v; 

CM 



*4 

u 



u 




OOOOOOOOO 

C/3 



3 

> 



o 

o) 

a 



me 



m 

r- 



vO 

On 



m 



GO 

C 



cd 



D 

Si 




u 

U 



>% 

s >% 

cd c 
CL cd 

E & 

0 E 
^ o 

t~ o 

1 ° 

^ c 

O cd 



c 

o 



C /3 

C 



<D 

<L> 

>% 

O 



CD 



3 

C/3 

C 

o 

o 

CD 
TD 
u- 'c /5 

QD *-> 

f | 

c 5 

cd cd 

J 3 

T 3 T 3 

5 <u 

5 y 

-O 'O 
c C 
o O 

U u 



c 

o 

*c 

3 



cd 

I ^ 

+-j cd 
cd > 
o > 
3 t~ 
-a <d 
<D -3 

cd 
-3 



o 

CD 

_ E 

u- o 
o " 
<d .S 

h GO — 

o = 

>> 15 rs 
<-> > 
cd g 
13 >> a, 

3 -3 w 

3 7 , ’w 

T3 2 ^ 

3 £ 

O 5 t- 

u o o 



— • cn m or ^ 
on 

s 

> 



<D 

-a 



o 

c 



<D 

a. 

E 

<u 

1— 

3 

O 

>> 

O- >% 

-O ^ 
O -o 

•— ' <D 
CL »- 

<D ' 

CD 



-a 

o 

u. 

'5 

a* 

<d 



3 

3" 

<D 

t— 

GO 

c 



-D 

O 



c/3 



g >-5 

.E <+- 
c o 

’B >% 
c 
cd 



H 

j' 

LU 



cd 



H 

X 

UJ 

H 



> a 



* 

o 



3 

O 

>% 

CL 

L> 



3 

O 

>% 



S o 
> Z 



~ CN 



m 

g 

4 

> 



3 
O 
>% 

c 
o 
c 

.2 
’■*— ► 
o 

CD E 

u o 

§ CL 

4 - 

« z 

0 GO 
-a 2 

a> s. 

.b ^ 

g- a 

2 s 

u 

GO <L> 

c c 

*5 GO 

*B .E 

Z c 

1 i 

cd ^ 

C/3 

GO * p 

o -5 

CL ^ 
cd >» 
£ § 

j‘ s 
u £ <>■ 




8 o 

>« Z 



_ <N 



C/D 

g 

> 



o 

c 




GO 

c 

*5 

*B 



T3 

C 

<L> 

op «• 

1 § 

cd >% 



.E 



u 



•s a 



> 



CO 

c\i 

CM 



CO 

CM 




r^ 



vo 

Ov 



m 



.S 

*E 

*c 5 



c 

D 
Q. 

CO 

3 
O 
0^ 
. — co 



oo 

c 

!e 

’ E 



** c 



c 

cu 

Q. 

cn 



oo 

-X 

D 

D 

£ 



D 

JO 

E 

3 

c 



CJ 



<+H 

o 

Lm 

D 


o 

4 -* 

<u 

-C 




CO 

u. 


co 

Un 


co 

Un 


co 


CO 

Lm 

3 


CO 

i— 

3 

O 


co 

L- 

3 

O 


-O 


4 -* 




3 


3 


3 


O 


J= 


X= 


E 

3 

c 


a 

CO 




3 

O 

-3 


O 

-C 

O 


O 

JC 

o 


O 

XO 

o 


-C 

o 

CM 


o 

VO 

m 


o 

o 

vn 


, , 


3 


co 


o 


(N 




oo 




i 


i 




O 


C5 




i 


i 


1 


i 


— — 


— — 


-*-* 

o 


0^ 

-n 


£ 


i 




CM 


TT 


00 


CM 


VO 

m 



3 

o 

-10 

o 

o 

vn 

c 

C 3 

x: 



o 

s 



(N m \o h- oo 



00 

UU 

S 

< 

> 




<u 



c/3 



(JU 



<L> 



D 



oo 

g 

3? 

> 



00 

c 

’5 

*c3 



<D 

> 

O 

o 

co 

D 

CO 

L~ 

3 

O 

U 

D 

CO 

<D 



,, M-h 

g. 0 
>% >> 
H c 



eu 

% 

H 

< 

a 

H 

m-3 



m 

•CV? 

02 



oo h 



c 

D 

E 

q. 

o 

<D 

> 

<D 

-o 

■ 4 —* 

c 

D 

E 

D 

00 

C3 

c 

cc 3 

E 

u. 

O C 



> .2 

'§ & 
o D 
D Cl 
X 3 
UJ C /3 



= C 

15 1 
co ctf 

13 ** 

.52 c 

C <D 

-c g 

0 E 
D .9- 

< 3 

1 S’ 
£°, 
1 ) cS 

> £ 3 
■S -2 -o 

C „ r- 
O D 



C 

o 

o 






3 £ 
> ^ 
> -C 



1 oo 

o .S 

*o a> 

2 •£ 
C 

o E 
u 

>-, o 



fc- O o 
cu oo h=; 



■© §3 
a £ 



03 [jj 

T3 Q 




S O 




u 


c/} 


H w 


W 


X 


D 


W 


J 


H 


< 


a 


> 



(N m h* 



ev> 

CM 



erIc 



<72 

Q 



Z 

o 



H 1 
to U 
« uj 
f— m 

12 O 

<u -7 

£ 

CQ 



'O 

On 



m 



00 ON 



d> 

DO 



^ d> 

UJ £ 



* 

u 



CJ 



S o 
> Z 



^ <N 



c /) 

s 

> 



C 

o 

c 

.2 

o 

E 

o 

Urn 

C X 
Ctf 

"S 

DC 



* 

CJ 



cj 



d> o 

^ Z 



<N 



OO 

g 

> 




DO 



cd 



d> 

d> 




CJ 



CJ 



C/5 

g 

> 



d> 

co 

d> 



J> 

CM 

CQ 



u 



u 



co 



co co co 



3 

O 

-3 

o 



3 

O 

J= 

o 

CN 



3 

O 

_C 



u. 3 
3 3 0 

O O -C 
-C -C ^ 

O O <N m m 
00 — 



o 

NO 



3 

O 

-C 

O 

O 

Cn 

c 

cd 



d> 



r: 'r o 



( co , — — — — « CQ QD 

. — - — (N^oo- — cn ^ 

co 

d> 

[2 . — (Ncn^r^'or-Qo 

3 

O C/5 



> 



CD 

CM 

CM 



O 

ERIC 



NO 

r- 



no 

ON 



m 



CN 




o- 

<D 

E 



U 



U 



<2 o 
> Z 



— « (N 



on 

g 

> 



W 

0 
z 
< 

01 



c/3 



E 

o 



a 

u 

a> 

cu 



d> 



c 
O 

c3 

Q. 
3 
O 

o 

o 

— u- 
GO 3 

c o 

*5 ^ 

r 9 o 
U <u 

§ * 

.2 u 

tS 3 
Ou O 
3 



CQ 

u 



o 

o 

o 

J 

au 

CO 

< 

J 

fi£ 

< 



o 

-a 



c*~ 

o 

c 



z 

O 

H 

< 



O 

U 

o 



u 



u 



> a 



(N 

CU 

X 

UQ 

U 

CJ 

o 



c/3 

g 

3? 

> 



r- 

un 

^cT 



W 



< 

> 



D 

Z 

a 

< 



o- 

E 



30 

C 

o 

<L> 



<D 

x> 



U 



O 



x 

d) 

c 



c 

o 

c 

o 

ts 

Q- 

3 

O 

O 

o 

d> 

-a 

o 

o 

<D O 
oo C 
cd 2 
CD £ 

CL ° 
& on 



CD 

GO 

CD C 

E 15 
3 | 
a> E 
x: o 
H c/3 



^ (N 



c/3 

g 

> 



CT5 

CNj 




00 

*15 

o 

t3 

E 

a> 

sz 

aS 



a> 

o 

c 

<D 

3 

S3 

c 



i 



o a> &o 



a ^ 

c 03 
5 CD 
O Q. 

U c/3 



NO 



D 

Z 



< a 

> < 



co 

Qj 

<M 



er|c 



7/3 1/96 B&B Field Test IDS 

TRAINING SECTION 



C^- 

C^- 



00 

c 

"5 

c 

oo cd 



.2 o 

O JC 

» E 



C/3 

00 

c 



C/3 



<u 

T3 

C 

D 



o 

& 

o 

<u 



C/3 



o 

z 



— (N 
GO 



GO 



U 

CJ 

PJ 

£ 

u 



c/3 

w 

D 

< 

> 



C/3 

03 

-a 

cd 

Urn 

oo 

u- 

3 

O 



o 

— o 

O JC 
O O 
4= 1/5 
o 

C/3 



00 



00 ' 



*4 

O 



CJ 






C/3 C/3 C/3 c/3 C/3 C/3 ^ 

< CQ CQ U U Q a 

^ TD T3 T3 5/5 

•a c c 



cd oo cd 
® 00 



00 cd 



° Cfl ^ w 5 Cfl U 

2 < S OQ 2 CJ O 

— (N m Tt* vo 

GO 

§ 

> 



CJ 



<U -r- 



w CQ 



o 

ERIC 



00 



no 

On 



co 




U 



3 

O 

c 

cd 



<d 



cd 

o 

t: 

<d 

o 



c/5 

<D 

C/5 

C 

0 > 

o 



c/5 C^~ - * 

o cd ^ 

2E? 
g> -2 a: 

-a .9* U 

c — Z 
* § w c 
E J= « 

cd 
cd 



GO 

< 

C/f 



o o E 

oo 

-3 JS ^ £ 

O .SPfc O 

>% w X 



GO 

s 

> 



cd > 

u d 

3 ht 



o 

w 

E 

CJ 



» <l> 

g CD 

•8 ® 



&o 



c/5 

~<D 
cd O 



CD 

4 —* 

cd 
o 
«3 

*c 

CD 

o 

CD 

cd 
cd 

u- 
D 

-a £ 




o 

o 

C/5 

C/5 

< 



cd 

o 

0 
cd 

-O 

1 

00 

O 

P* 



CD 




S 


CD 


go" 




ob 

CD 


s 


CD 

(D 

u- 


-a 

4— > 


<f 


00 

o 


C/5 


s 


-a 


Jed 




Id 


o 


CD 


c 


CD 

CL 


CD 

u. 

00 


_o 

’So 


C/5 

C 


CD 

T 3 


00 

rfP 



Q % 

x § 

cu .« 

CD "53 

u. cd 
00 O 
CD tC 

-a 



cd <d 

3 to 

-a £ 
LU 2 



cd 
u. 
O 

4 -* 

o 

o 

£ Q 



t : 

<D 

O 



C/5 



— cNro^^vor^oo 

GO 

LU 

D 

-) 

< 

> 



GO 

O' 

LU 

H 



NO 

On 



O 

NO 



O ^ 



cn 

CO 

CM 



o 



GO 

s 

> 



oo 

aC 

LU 

H 



CN1 

CO 

CN3 



o 

ERIC 



Os 

r- . • 



so 

Os 



m 






* 

CJ 



C/3 

e 

> 



C/3 

j 2 




* 

U 



C/3 

g 

> 



C/3 

C* 

W 

H 



Os 

o' 

CN 



cu 

I— I 

C/3 



u 



u 



C/3 

s 

> 



Os 

o" 

ri 



o 



SO 



cs 




kO 

CO 

CM 



u 



C/3 

§ 

* 

> 



00 

C^J 



oo 

c* 

u 

H 



o 

ERIC 



o 

CO 



0 

ERIC 



c 



U 




^(Sni-(n\OhooONO 
OOOOOOOOO — 

00 



3 

> 



00 

e* 

w 

H 




U 



oo 

E 

3 

O 

>% 

C/i 

<L> 



O 

ctf 



<D 

J= 

■*—> 

00 
c 
' c 

3 

T3 

u. 

O 

£ 

<3 

<D 
•*— * 
C 
J3 

O 

> 



<1> 

O 

'E 

<D 



o 

•o o. 


Yes 

No 


3 co 
o a> 


>% 

T3 *-* 


— (N 


. — c/a 

Q * 


00 

LU 



D 

J 

< 

> 



Oj 

2 

00 



CO 

CO 



u 




TD 

T3 T3 (U 
(U (U v 

a at 

<D <L> P 

X S £ 



F-Mn^vi^Oh- 

o o o o o o o 




CO 

CO 

CM 



03 

E 

o 

_C 

a. 

3 

O 

Urn 

3 ) 

„ Vi 
03 ~ 

§1 
•£ 2 

•i * 

3 Z' 
c *C 

. CO 

co B 
•3 *c 
a. a. 

vi 

O ‘ 

JZ 



J, >* 

«-» o U* 
CO (U ^ 
o' ^ 

2 U4 

03 ^ 

c 8 



TD 

03 



— 03 

03 -C 



O .t- — 

> J O 



o- 

c/1 

03 



NO 

ON 



00 ON o 
o o — 



C/3 



m 



CJ 

s 



cO 

03 

w 

C 

-T5 *3 O 
jC* 03 C Vi 

•5 £ o 8 

Q > S j 



n o 



on 



§ 



c 

o 

E 

03 

03 

£ 

CO 

-o 

JZ 

o 

CO 

03 



c 

j>% o 

JJ T3 

U3 Vi 
C CO 
3 X> 
u- co >> 

,o <i> y 

tii c/i c 
C 03 
» * O 3 

u 9- ST 



O 



J= 

U 

X 

u 



c/i 03 
P fH 



u 



UJ 

3 

< 

> 



3 

O 

x: 

>% 

c 

CO 

E 

* c- 

5 fe 

^ 03 

5 c 

O 3 



co 

03" 

33 

co 

w- 

03 . 
> • 
CO ’ 

c > 
O 

H 

X 

UJ 

H 

a 



CO 

03 

>> 



on 

g 

> 



u 



u 



Vi 

03 j: 
>* ^ 



on 



> 



05 

CO 

C3 




u 

g 



03 

JZ 



c 

o 



o 

03 



cO 

c 

o 

to 

c 

v— 

o 

03 
-*— > 
cO 

to 



CO 

C/l (J 



03 

c 

CN CO 



0- 

c/l 

1— 

* «* 
03 
>> 

CN 

•*-* 

co 

cO 



S o 

> z 



^ CN 



on 



g 




GO 

CO 

03 



W 




VARNAME: POLMEET VARLABEL: GO TO POLITICAL MEETINGS? RANC 

AQ NUM: 5 1 0 QTEXT : In the last 2 year, did you go to any political meetings, SKIP: 



<N 

oo 



■C\J 



o 

ERIC 



u 

u 



u 



JC 

<D 

co 

00 

c 



<D 



| % 
■£ » 
> cd 

Is 

*5 C 

2 S 

b o 

~ CO 
>> 2 
si 

JD ex 
Cl (d 
O _C 
<D 

a- 

>, ° 

C CD 

a c 

o ° 

«-• CD 

£ o 

a3 > 

3 2 

° 5 

>> o 



T 3 

5 



0> 




JZ 




o 




-4— » 


c^- 


t: 


tt> 


o 


S 


aT3 


ex 


-5 


3 


c 


co 


03 


*2 


CD 




u. 


*o 

c 


O 


a3 




c 


t: 




03 


i— 


ex 


<u 


_ _ 


-C 


03 


•4—* 


O 


o 


<*-4 


L- 


L3 


o 


o 


>> 


ex 


CD 


>> 


c 


c 


o 


cc3 


E 


L- 

,o 


>> 




c 

cc3 


c 

op 


CD 

> 


E 

ex 


Ho 


E 


3 


cc3 


O 


CD 


>> 


<D 


;o 


-C 

-4— > 



3 

O 

>, 

co 

co 

( 1 ) 

Un 

ex 

X 

<u 



2 

‘5 

o- $ t 3 
co o 

§•.8 
- S 3 
b «> g . 

C G 

o O >> 

E o « 
u cd o 

2 s r 

e .2 « 

H \5 ^ 

. 3 • LL -4—* 

- 0-2 



c JC 



cu 03 

<D 



-4—* <4-* 

o *C 

w £ 

«3 C^* 

S O C 
a. O o 

o « .5 
«* S §• 
X 



co Q 
CD ^ 

>4 2 



— <N 



c/d 



so 

as 



m 



i. 

> 



240 



m 

oo 



ON 



m 




cd 



c 

o 




> a 




* 

o 



GO 

g 

> 



X 

uj 

CD 




S 




u 



JD 

J£ E 

si 



^ <N 
CO 



* 

> 






C/3 _ 

(D O 

>- Z 



<N 



g 

4 



X 

u 

S- 

a 



on 

§ 

4 

> 




00 

CM 



CM 

Tt* 

CM 




Tt* 

00 



Uu 



NO 

ON 



m 




Z 

o 

p 

co 



ov. 

§ '5b 
O ‘g 

2 S 

O c 

r >v ^ 

U a. 




a 

o 




u 

u 



u 



<D 

> 



o 

Z 



— CN 
CO 



< 

> 



z 

o 

H 

co 

W 

5 

a 

> 

H 

U 



H 

W 

u 




* 

u 



o 



c 

d> 

o 

C /5 

<L> 

T 3 

O 

c 

cd 

a 

IE 

U 




^ n rt 

co 

W 

5 




u 



u 



<u 

> 

c 3 

Z 



CD 



— CN co rf ir^ 



CO 

CD 

D 



o 

ERIC 



to 

•Xjl 

C\J 



OJ 



00 



vO 

On 



m 






U 



u 



04 

GO 

O 







c 


<D 


o 


2 


co 

<D 


c 


*c3 


C 






IE 

U 


IE 


ccS 

S 




04 


m 


o 


O 


o 



<D 

co 

4> 

C 

ccS 

O. 

<t3 



rr 

o 



u .1 

D T3 

e a 

I g 

.1 •§ 



a> 

T3 

C 

ccS 



O 
«S 
CX 
u- u. 
O O 



c 

2 

'55 

< 



> < £ a o 



cn vo 
o o 



r- 00 ON O 

o o o — 



GO 

e 

* 

> 




,a> 

a> 



a 

*JE 

CO 

C 

.2 
’•*— * 
aj 



co 

<D 



c o- 

J-g-g 

S -6 £ 

§• fc* P 



c 

ccj 



u 



>% 
<d .ti 
> m 



U 



XI « £ 
n £ a) 


S o 


.2 3 i_ 

a o g 


>h 2 


J o ^ 


^ 04 


UQf 




<i H ^ 


GO 

g 


> O' 


> 



CO 

CM 



o 

ERIC 



247 



VO 

oo 



VO 

Ov 



m 



2 

CO 




S o 



— <N 



CO 

g 

> 




.2 Uh 



*J O 



C5 

C\2 



u 



u 



c 
. 2 
*5 
o 
x 

E 

cO 

CJ 



o 

U 



c 

cO 

QJ 


C /2 

u 

E 


W 

C /2 

D 


o 

-5 

c 




cf 

.2 
’ vZ 


X> 


CO 


C 


CO 




cO 


P 

c" 

cO 


c 

- 4 —* 

<D 

> 


cO 

S 

c 0 

H 


<u 

o 

xf 




JX) 

3 

PQ 


<D 

L- 

o 


o" 

cO 


<lT 

C /2 


. 2 
*5 




c" 

.2 




nJ 


0) 

c 


CO 

a 




*55 

C /2 

—5 


c 

.2 

*c 75 


*c 3 

X 

H 


o 

c 

cO 


c/2 

<D 

CJ) 

cO 




5 

JO 


< 




u 








of) 

o 


(- r 


3 


X 

C /2 


OQ 



cO 

CD 

X 

3 

O 

CO 



CO 

CJ) 

cO 

H 

cf ' 

CO 



cO 

T 3 

C 

CO 

2 



«£S c bSo( 3 ^ 

2*agES-3i*g>s 

C cO Jr? *— X w « o 

oo. 2«^5 3 S ° - 5 



c 

<D .2 

c/2 > 

0) CO 

H 

E «* 
o o 

CU CO 



C T3 
CO <D 
-1 £ 
CO 



2 

CJ) U 
<L> 



c 

cO 






o 

> 

cO 

CO 

r c 
co 



c 

CO 



c /2 0) 
CL) 00 

CJ) J 

2 -c 

3 )j 

c o 
CU 



- (N n vo h 

o o o o o o o 
co 



00 ov o 
o o — 



X X 

S •- O (D 
u > <U <L> 
O i N 

z CO CJ O 



r- <N 



4 

> 



me 



co 

«^*jr 

evi 



* 



r- 

oo 



£ 



c 

.S 
* c 

00 

c 

PS 



e 

c ^ 

& s 

s § 

op 3 

cd 

a 3 

c ^ 

cd -r 

J cd 

§ £ 

<U cd 

3 § 



3 

H 

c 

cd 

c 

cd 



on 

cd 



i 

T 3 

1 



jo 

cd 

‘cT 

3 

flu 



cd 

00 

c 

<u 

PC 

3" 

TO 



C 

cd 

E 

u. 

<U 

o 

TO 



3 

Q 



o> _ 

T3 E 

•2< 



<D 



§ W c 
Sul 2 
*uu 



X> 

cd 



< o 



r) *3 

o'-5 / c'? 
5 c Cd 
2 ts -n .2 

= * t> = 
c « 2 
§ cq £ 

* ‘Ui ~ <L> 

. < *c O 

4> jC u- 

”S 3 g Jc 
O O r 5 ^ 
CQ OO 00 O 



c 
2 
‘c 

cd 

E 
o 

C/5 

<u 
00 

_ cd 
'P 3 

o «> 

s ®* O' 

OO ^ O 

_ C/3 

00 C 

2 S r 

* 2 E 
o E o 
O 0 * 

c * ‘ 



a w 2 

ro ^ u 

— cd 



* C/5 



cd 

PQ 

u- 

cd 

<u 

c 

«-* 

c 

<L> 



cd 

E 

cd 



C 

2 

45 

cd 

U* 



C 

.2 

’c 7i 

Urn 

<D 

cu 

to 

O 

cd 
-*— * 
CA) 
0> 

< 



£ 2 
^ o 



TO 

C 

cd 



> cd 

S .2 

V- C/5 

O C/5 

<5 cd 



r— y-' ^ 

O 5 3= u 



Ou 
O 

O 

c 

2 

u— > 
Ou ^ 
S cd 

So 00 

U D 



C/5 .TO 

<l> c 

g> B 

3 

g> c 
§ 5 
J Z 

S.g 

o 

*C u 

<D { J 

5 <D 

^ 3 
a> o' 

> s 

« 03 

Z <s 

C /5 Cd 
4) 30 

00 P? 
3 2 
3) 2 
§ D 



0 3 0 

J3 U X 
♦d cd +d 

D cu O 



m 3" 



vn vo 



On 



O 

CN CN 



<N 

CN 



CO 

CN 



vO 

Cv 

co 




00 

c 



Q 



2 

s 



< 'O 
Pu 



CO 

vn 




m 

CM 



u 



u 



o 

o 



o 

C/5 



O 

o 

X 

o 

C/5 

X 

00 

2 

c 

cd 



C/5 

<D 

— C 

| 3 

3 1 

.|S 

C/5 cd 
3 § 



«e .2 j 

O 3 s 



a> ^ 
—1 cd 
2 <-> 
2 o 



c 

o 

td 

3 

TO 

cd 

u~ 

00 



•3 2 

C cd 
O <D 
’3 ^ 

5 cy 

O C 
> cd 

cd w 
a> c/5 

^ 00 



75 - - £ 



o 

o 

X 

O 



<D 

TO 

cd 

1— 

< a> 

11 
.2 O 
« « 

8 O 
> on 

2 « 

O ^ 

CN 



on 

(D 

mJ 



Q -3 

m 00 

O PC 



S 3 

cd 



tsj 

s « 

o> > 

J - 



5 S 



0> 



00 



a> 

TO 



C/5 

“o 

cd 

o 

o 

on 

on 

< 



s 



00 

o 



O 

LO 

CM 




00 

00 



u 

U 

tq 

I 

U 



o 

o 



00 

Q 



CO 

CD 

H 



c/3 

U 

£ 

cu 



O 



ON 

ro 

ON 

OQ 

<* 

DQ 



O 

S 

tQ 

Q 



§e 



00 



£ « « « 



<N DQ 2 Jju 



s 



O 

o 



o 

CO 



00 



CO 

CO 

<D 

_ C 

g *55 "o 

J j ° 

CO ;2 _ 

S 2 « 

c < « 



co 03 

n = a 
•S .2 | 

« 13 43 
o -a 
_ o os 

co ^ 



T3 

o3 



C 

o 

oj 

-o 

o3 



ca 

£ ea 

.2 go 

S <n g 
o c g 
> 



> c§ 



_ « *- « 

00 « s s 

o - J* S 



CD 

00 

o 

u 

t*-, 

O 

CO 

V- 

o3 

a> 

>> 



CD 

00 

o 

o 



a3 

CD 

m 

^r 



U 

H 

W 

c/f 

Q 

Q 

o' 

o 

o' 

2 

le 

03 v — ' 
> <D 



<N 



§ -5 § J 

-5 % ■£ Z 2 

W Q X CO ^ ^ 

gw^S £ & 

j O kH ^ cn 



o 5 S 



(D ^ 

£ o 
ob £2 

<D ca 
T3 CD 
co 

"CD CD 



a" oo 
cd a> 

u- T3 

o o — - 

<u ^ 03 
v— iD f— 
00 <L> 



03 O 

O ? 

CO g 

co O 
< <N 



O 
00 ' 55 

D CO 

a ,cd 



co 



O 

Lm 

CL 
^ CD 



CD 

<D 

w 

00 

o 

T3 

15 

c 

o 

co 

CO ^ 

<£ Q 
o 

S. w 

■si 

= S 

> <l> 
■8 « 



SCO 



O 

u 

o 

Q 



NO 

ON 



m 



-(Nn'tiniohoo^o 

ooooooooo — 

00 

s 

— 1 

< 

> 



^ (N n 



o 

ERIC 



CT! 

ID 

CQ 



cnj 

io 

oa 



ON 

00 



ON 



NO 

ON 



m 




o- 

C/3 

b 



o- 

C/3 

03 

13 

C/3 

T3 

<D 

‘E 

D 

CD 



£ c 



U 



U 



03 



O 

£ 



— CN 
C/3 



3 

> 



ON 

ON 

ON 

ON 

NO 

ON 

ON 

o' 

00 

00 



03 



* 

u 

uu 

I 

u 



C/3 

UJ 

D 

< 

> 




U 



u 



c/3 

3 

A 

> 



. O' 

I ON 
I ON 
ON 

NO 

ON 

ON 

cT 

oo 

00 



03 O 

>* 2 



— <N 



03 On 



5>D 



O 



U 

u 



u 



go 



-> 

< 

> 



in 

LO 

03 



in 

03 




o 

On 



<L> 



c3 



o 

LU 

X 

U 



o 

o> 

u, 

u- 

O 

O 

CO 

c3 



o 

u 

u 

w 

O 

O 

■ 4 — » 

o 

c 

co 

cS 



£ o 

>* 2 



— (N 



C/5 

LU 

D 

J 

< 

> 



U 



CO 

C 

O 

J3 

CD 

u- 

CL) 

CL) 

OX) 

o3 



TD 

CL) 



03 

E 



c E 



CD 



CD 

CD 

JO 



-a 

<u 



03 



-a 

a; T3 
JO CD 
03 CD 



03 O 
Q- > 
CD ~ 

m Q 



T3 

% 

o 

T3 



^ (N n cn \o 
on 

g 

3! 

> 



8*8 

4— » 

00 <d" 

11 

J c/5 



<N 

C+H 




CD 

o 

_C 

CO 

5 

t3 



o3 

s 

3 

o 

>% 

c 

CD 

00 

c 

o3 



>4 

C 

03 

C 

a> 

CD 

JO 



« E -2 



03 

I 

H 

X 

LU 

H 

a 



£ 

00 

c 

> 

c 

3 

00 

CD 

-O 

O ^ 
X3 .9- 



os ,2 
S a3 
C a> 

CD U 
(D 

o j* 

00 L3 

3 <L 
O DO 
>% 03 

> ’*= 

< 03 

E 

r « 



03 



CD 

C 

o 



<D CD 

o | 

Uh CO 



TT 

^r 




V 



a> o 
5 h Z 



(N 



CO 

g 

> 



■r^ 

in 

on 



o 

z 

bu 




O 

ERIC 



co 

VO 

CM 



7/3 1/96 B&B:93/97 Field Test IDS 

DEMOGRAPHICS 



ON 




^ ^ “ 

Q £ -Sr Q 5=,< 



* 

u 







O ^ CN m '*t NO 



GO 



3 

> 



u 



V 5 

C 

o 

'■*0 

<u 

l— 

0> 



2P S 

.2 'C 
w u. 
b cd 



c 

^3 (3D 



"O -Q 

T3 £ ® « 

1 2 2 | 

*3 g- > 5 .5. „ 

S £ q ^ j z 



s JJ 

g» fc 
> $ 



CN ro tJ- t/D vO 
GO 



> 



05 

HD 

CVi 



00 

kD 

(M 




<N 

On 



\o 

ON 



co 



o 

<D 



O 

o 



CO 

-c 



H 

00 

< 

nJ 

< 



UJ >. 



U 



o 

0 > 



o 

<u 



O 

o 



o 
c 

V2 V2 



c •*-' ^ 

<U ^ C3 

i~ *c _e 



S o 



<N 



CO 

g 

=a 

> 




* 

U 



u 



o 

4 ) 

- t 
O o 
£ 8 
t— 

o o 
t-> c 

.22 .2 

4-» 

-C 

s o' 

>, 2 



— CN 



CO 

g 

> 



<N 



U 



£ o 

IX £ 



^ <N 



CO 

W 

D 



«p*W 

GO 

CM 



on 

g 

> 



O 

ERIC 



o 

CO 

CM 



m 

ON 



C/3 

Q 

tS U 

D — 

E- X 

- S 3 

4 2 

on O 

s s 

ON Mj 

CQ‘ Q 
OQ 



NO 

ON 



m 



NT> 

o' 



u 



C/3 

B 

9 

> 



NO 

ON 

o' 

NO 

<n~ 



03 

o 

c 



T3 

o3 

X 

03 

> 

o3 

X 

3 

O 

>% 

c 

03 



Z 

s 

Q 

J 

55 

u 

pp 

o 

C/3 

LU 

H 

< 



o 



C/3 

C/3 



1 3 



H 

* 

5 

P 

lu 

9 

Mj 

$ 

> 



o 

>> 

c 

03 



co 

>% 

03 

TD 

X 

C 



c 




03 




u- 


Pm 


2 


O 


X 




o 


CO 




03 


c 


CJ) 


03 


c 


"O 


3 


c 


O 


03 




a. 




03 


x 


-a 


03 


,*_* 


C 


co 




03 

00 


co 

03 


c 


00 


3 


c 


O 


3 




O 


c 




03 


' w ' 


*■» 


03 


03 


X 


X 


■*-•* 




Pm 


c 


O 


o 


03 






c 


03 



o .2 5 



Q 

hU 

55 

u 

c* 

< 

Pm 

T 

H 

X 

LU 

H 

a 



03 
X 
«— * 

£ 

o 

c 

X 

O 

-o 

03 

03 

c 



zf 

s PU 



< 

LU 

H 

< 

Q 

a 

o 

< 



03 

E 

u. 

<£ 

c 



X) 

03 

X 



co 

(13 • — 

o J 
£ 



-a 

« • 03 

c •= o 
i 0*5 



Z 
LU 
o- Q 

S z 

L- [rj 

2 a 

IE LU 
Q 

< 

fc > 

I :> 



03 

X 



03 

X 



CJ 



o- 

2 

X 

o 

Urn 

3 

O 

Pm 

^ O 
— 03 

03 

-o 

X 

t: 



C/3 

s 

9 

> 



03 

03 

c n 

— X 

hU Pm 

2 ° 

a. 

< -c 

it 

> ° 

j •- 

r &0 

z | 

LU x 

P 3 
Z o 



o 

cu _ 

C/3 03 



03 



00 
c 
’ 55 
3 
O 



O 

03 

CL 

■*— * 

c3 



J x — 

uJ £ 3 



C 

03 




, — (N m 3" Nn no r- 
C/3 



9 

> 



CO 

CD 

CN{ 



evj 

CN? 




.• 



*0 

CO 

OJ 



TT 

ON 



NO 

ON 



m 



O 

ERIC 




C ft 

<D 

to 

<D 

X) 

o' 

On 

On 




U 

w 

sc 

o 



o 

g « 

J 3 

cd O 

C/5 

> .E 

~ <t> 

c g- 

QJ O 

-a v 

C CL 
O w- 
n <V 
on jC 
<D 

o' O 



— CN 
C/3 



J 

< 

> 




u 



GO 

g 

i. 

> 



<D 



00 



u 



c/3 

g 

i, 

> 



CO 

CSJ 



ON 



NO 

ON 






c 

o 

<D 

E 

o3 

C 

a> 

-c 



t: 

o3 

CL 

'aS 

C/3 

3 

O 

CL 



3 

o c 

<L> 

<+« g 

o 

£ 8 

E so 

Cd Cd 
C — 
cd 

<D *-> 

JC c 

~ <D 
u «- 
O u. 
O 

<L> <L> 

E op 

Cd 

C 

u- t: 

3 O 

&E 

- S 



H 

X 

W 

H 

a 



o 



NO 

00 

Nn 




U 



D o 
> Z 



— CN 

oo 

UJ 

D 

< 

> 




a> 

T3 

aj 

OX) o- 



U 



o 

a> 



o 

o 



o 

<L> 

u- 

u. 

O 

o 

o 

c 

C/3 



S o' 

> z 



— CN 



00 

g 

■i 

> 




to 

CQ 



3 

O 

>% 

1 *-> 

u 1 

S B 
3 .2 

z g 

O 3 

►— t ’o 

H o 

5 f 

D » 

Q a> o- 
UJ ’ ' ~o 

H O ^ 

£ » « 

S T3 CL 

2 E 

o *> 8 

■— ! <4—* 

C/3 C/3 

a) cd 



<D 



-J— > -J 

H £ g. 



u 




^Mn^t^NOhooONO 
OOOOOOOOO — 

00 



— CN m 



4 

> 



<o 

to 

CN! 



ERjt 



C7D 
C D 

03 



vO 

ON 



<N 



2 .s 



* 

U 



u 



S o 

Z 



— <N 



CO 



* 

U 

X 

X 

u 



<D 

CO 

cj 



cO 

c 

_o 

’c75 



X J> 

_ 8 § 

5 ° Cs o 

CJ ^ GO CO w 

3 Cl 



,<D 



•= <D 
SX) cj 



C <L> 



cO ^ 



X X X CP x 



— (N n m 



CO 

X 

X 



CD 



;>% i 

o c 





CD 



w ^ 



* 

u 



u 



o 

<D C 

E | 
x x 

*3 cO 

<2 o. 

*0 D 

SC g.1 

o o g' 
E E E 

5 « 5 

S S o 

>- >• z 



— <N m 
CO 



X 

< 

> 



vO 

On 



LU ON 

•-M iy-, 



m 



Of) 

CD 

04 




r- 

ON 



D 



vO 

ON 



m 



o 

(N 



CJ 



U 

CO 



C 



3 

O 



4 -j 

ctf 



CD 3 
C O 

E >n 

2 "o 

^ c 

^ cs 

crt w 

3 i 
O <D 



Cl 

C/3 

U. 

3 

O 

>> 



c/a 

u. 

3 

O 

>> 

<D 

-o 



<D 

u- 

O 

E 

TD 

D 

> 

‘S 

o 

CD 



C — 
ctf O 



3 O 



V-/ ^ 

C £ 



3 

O 

>% 



O < 
H ^ 



o 

^ cu 

-2 e- 

Q- ^ 

0 ss 

CD ccj 

O- O 
>% c 
c 2 

cS C 

E *G 

1 *• 

. . 3 

H " 
X 
uu 
H 

a 



CD 

c 

o 

S 3 

ctf o 
-o >*» 

S E 
^<2 
CL) ^ 
3 * 
t: o 

cd CX 
CL CL 

<u 3 
So ^ 

3 # u- 

o '53 
cl Jc 
00 



c n 

s 

> 



(N 

ON 

IT) 



D 

£ 

a 

< 



o 

(N 



CJ 



0) 



c 3 



C/D 

g 

i 

> 



a 



'S 



p <D 



O O 



CD >, I 

f ^ - • 



<D C 
J3 ccj 



ccj a 



<d O 

2 2 

CD 

C ^ 
3 ^ 



CJ 



co 

g 

> 



© 

<D 



3 -C 

3 -4—* m 



°*-o 



c > h 

< 0^0 



vH 

cm 



' ^ u-/ 

~ = S?H 




oo 

> 



O 

H 



>% 

c 

a 




O 

I> 

CM 



O 

ERIC 



oo 

ON 



VO 



CM 



T3 

C 

03 

vO 

C 

<u 

<D 

£ 



<D 

T3 
C (U 
3 X> 

C C 
<L> 0 > 

i— u- 

IS IS 
IE IE 
U U 



NO 

ON 



co 



U 

UJ 

I 

u 



C/0 

UJ 

D 

< 

> 



o- 

<D 

Un 

03 

CD 

-o 



U 



£ o 

^ z 



CM 



in 

§ 

■i 

> 



m 



* 

U 



oo 

g 

> 



c H 



CO 

CM 



u 



o 

o 

o 



c 

03 

-C 

oo 

on 

CD 



00 

g 

i 

> 





O 


O 


o 


o 


o 


o 


O 


o 


o 


o 


o^ 


o 


o 


o 




o^ 


o' 


'w' 


o' 


o" 


o' 


oC 


o 


o" 


CM 


m 


in 








OO 


OO 


oo 


oo 


oo 


OO 


c 


c 


c 


c 


c 


c 


oj 


03 


o3 


03 


03 


03 


-c 


-C 


-C 


-C 


-C 


_c 


4—f 








' > 




CO 


CO 


CO 


CO 


CO 


C/5 


CO 


CO 


CO 


CO 


CO 


CO 


<L> 


CD 


<D 


<L> 


CD 


CD 














■*— » 


■*— » 


■*—> 


■*—> 


-♦— » 


■*— * 


3 


3 


3 


3 


3 


3 


_o 


_o 


-O 


-O 


-O 


-O 


O 


O 


O 


O 


O 


o 


o 


o 


O 


O 


O 


o 


o 


o 


O 


O^ 


O^ 




o' 


o' 


o' 


CD 


in 


in 


1— 


CM 


CO 


n 


r- 


oo 


oo 


00 


oo 


oo 


oo 


■*—* 


■*— * 


■*— * 




*-* 




CO 


CO 


CO 


CO 


CO 


CO 


o3 


03 


03 


03 


03 


03 


<U 


<D 


<D 


<D 


<U 


<D 














Oj 


c3 


c3 


03 


o$ 


03 


CM 


ro 






NO 


r-* 



O 

E 



o 

o 

cT 

o 



dj 

CM 



o 

ERIC 



ON 

.ON 



O 



>4 

o 



m 

CM 



u 



CJ 



vO 

ON 



m 



CD 



on 

g 

=* 

> 



^ = 



I o 




c 










bO 






cQ 


t > 


, , 


t , 


t . 


t * 




o 




c/3 


c/3 


C/3 


1/3 


C/3 


C/3 


o 


sz 


cd 


cs 


cs 


C3 


CS 


cn 




co 


<D 


CD 


CD 


CD 


CD 


CD 


oo 


00 






, . 








V- 


OJ 




Ctf 


03 


c3 


C3 


cS 


o 


_ 


(N 


m 




vn 


vO 


r- 


oo 



C/3 

g 

> 



on 



on 

g 

> 



5> 

CM 



O 

ERIC 



o 

o 



NO 

Os 



co 



GO 



>6 

U 



u 



o 

o 

o 



o 

o o o o o 

o o o o o 

<3 CD o Q 

o o o" go" o 

<N co go r- — 





GO 


GO 


GO 


GO 


GO 


GO 


3 


3 


3 


3 


3 


C 


o3 


o3 


03 


03 


03 


a 


-3 


-3 


-3 


-3 


-3 


-3 


* 




4— * 


-♦-* 






CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


<D 


<u 


<u 


<U 


<L> 


o 
























4-* 


3 


3 


3 


3 


3 


3 


-3 


-3 


-3 


_o 


-3 



O 

O 

CD 

go" 

GO 



-O 

o 

o 

go" 

GO 



o 

o 

o 



o 

o 

o 



o 

o 

o 



o o o o 
- M n ^ 



I/O 

r- 

GO GO GO GO GO 



03 


■4—* 


+—> 


■4—* 


-4—* 


4— ' 


'4—4 


-3 


CO 


CO 


CO 


CO 


CO 


CO 


4-4 


o3 


03 


03 


03 


03 


03 


co 






<L> 


V 


0) 


1> 


CO 

JD 


+-* 


, . 




, . 


, , 


t . 


03 


03 


03 


03 


03 


03 




<N 


ro 




GO 


SO 





GO 

g 

> 




a 



U 



U 



GO 

g 

> 



r- 

03 



cu 














<D 








E 


GO 






o 








o 








.E 






co" 

T3 






-o 


C 

<u 


o 


c 

o 


<U 

X 


T3 


GO 


CO 


03 


■> 


ON 


<D 


3 


*-5 


ON 



Q> 

c 

C 

03 

Q. 



<D 

CO 

3- 

O 

CL 

co 



3 

O 

<D 




* 

u 



u 





o 


O 


o 


o 


O 


o 


<o 






o' 


o" 


cT 


<N 


ro 


4-^ 


GO 


GO 


GO 


3 


C 


c 


o3 


03 


03 


-3 


-3 


-3 


■*-* 






CO 


CO 


CO 


CO 


CO 


CO 






a> 








-4—4 


-4—4 


4_» 


3 


3 


3 


-3 


-3 



i 


O 


§ 3 
5 £ 


o 


JO 


o 


o 


1 

CO 

_o 


E 


o 


O 


o 


o 


o 


<o 


O 


<o 




O 


G— * 


« « 


go" 


<0 


cf 


o' 


*n 


<U 

E 




GO 


go" 


1-^ 


<N 




• o o 

CO ^ •— , 

3 ^ — 


3 

03 


GO 

-4—4 


GO 

4—4 


GO 

4—4 


15 


o 

o 


5 2^ 


-3 

4—4 


CO 

o3 


CO 

o3 


CO 

o3 


E 


3 


00 3 E 


CO 


JJ 


JU 


JD 


o 

.L 

G-t 


u. 

O 


o 5 o 

-ts > <fc 


CO 

<L> 


15 


15 


15 



^ (N n 1- 
GO 



> 



CD 

fr' v '=9 

03 



er|c 



7/31/96 B&B.93/97 Field Test IDS 

DEMOGRAPHICS 



O 

O O O 
O O O 

q <o <o 

O go O 

^ 

GO GO GO 



C 

a 



cA cA n 

CO C/5 C/5 

(D (D <D 



3 3 

X) X 

o o 
o o 
o o 

CD O' 
CO go 
GO GO 



o3 

CD 



+-* u- 

3 O 

E 

o u 

§ ° 

£g 

!!§ 
co O 
o3 ^ 

-E ^ 



03 03 o3 O 



GO x I*** oo 



<N 




co 



3 

X 



c 

o 

o 



U 

U 



S o 
^ 2 



— <N 



C/D 

s 

> 



O 

c 




o- 

GO 

ON 

ON 



OJ 



<D 



03 






U 



o 

o 

uo" 

GO 

c 





O 


O 


O 


o 


O 


o 


O 


O 


O 


O 




o 






o 




o' 


o 


o" 


o' 


o" 


GO 


o 


o" 


(N 


co 


GO 


r- 




1— * 


GO 


GO 


GO 


GO 


GO 


GO 


c 


C 


c 


c 


c 


c 


Ctf 


oS 


03 


o3 


03 


03 


X 


X 


X 


X 


X 


X 






■*— * 


-*— * 


-*-* 




CO 


CO 


CO 


CO 


CO 


C/5 


CO 


CO 


CO 


CO 


CO 


CO 

JU 


<D 


CD 


0D 


(D 


<D 




t _ f 


,*_> 


,*_> 






3 


3 


3 


3 


3 


3 


X 


X 


X 


X 


X 


X 


o 


O 


o 


O 


O 


o 


o 


o 


o 


o 


o 


o 




<d 










o" 


cf 


o" 


o" 


go" 


GO* 




(N 


CO 


GO 


r- 


GO 


GO 


GO 


GO 


GO 


GO 


( . 


, . 


t 




t .i 




CO 


CO 


CO 


CO 


CO 


CO 


o3 


o3 


03 


03 


03 


03 


CD 


CD 


(D 


(D 


CD 


(D 


t t 


t t 










O 3 


03 


03 


03 


03 


03 


<N 


co 




GO 


X 


r- 



o 

E 



o 

o 

o 

o" 

o 

GO 



C/D 

g 

> 



03 

CM 



CO 

£> a 

CM 




CN 

O 



00 

Q 



m 

<D 

H 



r- 

ON 

CO 



On fTj 

aa Q 
aa 



NO 

ON 



CO 



U 



U 



o- 

U 



00 

00 

U 

Q 



o* 

in 

T3 

C 

<u 

-o 



-o 

c 

cc 



o* 

c/a 

o- +* 
c/a C 
u. <U 
<L> C 

-o £ 
E S' 

<D Q, 

E t 

>. o 

r= a. 

E §. 

<5 5 

fc ^ 

■5 2 

0 ° 

1 

o ° 

CO ^ 

C o 

£ E 

as 

D- 



c 

<D 

E 

S.SJ 

1 | 

v- ^ 
00 cu 

2 

a,c^ 
o O 

-R c 

5 o 

Q- c 



— CN CO Tf lo NO 
00 
§ 



CN 




* 

<J 

W 

X 

u 



S o 
> 2 



— CN 

00 

LU 

D 

< 

> 



% 



* 

U 



u 




i— i CN CO Tf NO 

oo 



4 

> 



ON 

ON 

ON 

ON 

ON 

ON 



H 

X 

W 



IS 

m 

a> 

D 

cr 



v-f 

GO 

03 



oo 

c 



el 



er|c 



o 

CO 

CM 



c - 



cn 

o 




no 

ON 



m 



fed 

u 



u 



co 

s 

i 

> 



ON 

ON 

ON 

ON 

ON 

ON 



3 

O 



w- 3 
tP ° 

w O 
CD O 
O ^3 

3 

O g 
« 5 




o- 

<D 


>1 E 


>C 


£ 

o 


E g 


E - 




*? E 


4-5 

i 


c n 


o ? 


§•• 


3 


c o 


C 


O 


^ x: 


1 




CO 

GO 

CVJ 



fed 

u 



o 



oo 

s 

> 



CNS 

00 

<M 



o 

ERIC 



o 



vO 

ON 






CM 




00 _ 
O c 
~ o 

C/3 \3 
cC 
O 
3 
T3 



D 

PU, 





C/3 


03 




CO 


03 


C/3 


-C 


c5 




CJ 


3 


13 


3 


TD 


o 


c/3 


a 

Urn 


J 


t/T 

c 


i^o 


UJ 


cO 

o 


l— . 

o 


H 




03 


< 


15 


t3 


D 


L- 

03 

-a 

cS 


3 

T3 

cC 

L- 

i50 






L- 


o 


c 

cC 


03 

T3 


d 


03 

> 


C 

3 


w 


* 03 
O 
03 


W 

3 

O 


Q 






W 


3 


o 


Uh 


O 


tic 




C/3 



U 



U 



S o 



— CN 



00 

g 

i. 

> 



CN 



00 X) 



u 

U 



U 



c 

c3 

_o 

15 

u. 

03 

T3 

,03 

0-t 

03 

C 

o 

>, 

S O c 
JH Z O 



■ — CN m 
00 



> 




* 

U 



U 



u 




CN 

o 



e b 
.2 < 
oS fc 

03 OO 

- 3 Z 
cr 03 



W 

o 



•JO 
H J 

d 

t—H 

C/3 



o- 

C 

O 

3 

O 

03 

Ctf 

c g 

«j pf2 

a. o. 

■*— * 

g s 

s i. 

ra“ c« 
Q. ©■ 
03 £> 
u- t- 

0- ^ 
o o 

03 03 

CL G- 

S 

H ~ 

• • c3 

W ^ 

CQ 7. 

< H 

d x 

5 w 

< H 

> a 



u 



u 



a> 

> 



§ 

£ - 
^ c 



.t i ST E 

Si 8- 

g c5 

£ nD 3 

3 2 g> 

£Ooi 



■ — i cn m 

oo 



3 

> 



er|c 



in 

f'O 

CM 



*3^ 

GO 

Cl 




vO 

On 



m 



* 

u 



CO 

s 

> 



l> 

00 

CM 



u 



o* 


a> 




LU 


T3 


E 


CO 


C 


o 


D 


t ^ 


O 


o 


<D 


Oh 


’*-* 

cd 


O 

c 


CO 


O 


C3 


7 


o 

T3 


4-» 

C/1 


<! 


0> 


‘co 

CO 


33 


u- 

3 


ctf 


H 

C* 


O 

>> 


<1> 

T3 


a 


CCJ 

Q- 


O 

.E 


H 


CD 


4-* 


O 


O 


o 

c 


>- 


4-* 


O 


< 


-J 

o 


Q 


0- 






UJ 


00 


O' 

CO 


Cu 


c 


&> 


£ 


’5. 

<u 


o 

V- 

3 



O 

^ Z 



CN 



6o 

g 

> 



CD 

00 

CM 



O 

ERIC 



VO 

O 



VO 

ON 



m 



<D <D 




CJ 



CJ 




c n 

g 

> 



ON 

ON 

ON 

ON 

ON 

ON 



<U 

<4— » 



* 

CJ 



CJ 



go 

g 

> 



VO 



OD 



<L> 



C/5 



CJ 



CJ 



GO 

g 

> 



ON 
ON 
ON 
ON 

o' 



u 



GO 

w 

D 

> 



o 

ERIC 



05 

ro 

cv> 



(X) 

CO 

ca 



o 



<u 




c 

.2 

eS 

o 

3 

TD 

<L> 



u 



S O 

5h Z 



— <N 



on 

s 

> 



on 



U 



on 

g 

> 



o 

o 

o 

o 

ro 



UQ 

on 

D 

O 

X 

o 

H 



on 



c 

o 

c5 

o 

3 

*D 

<D 



<L> 



<D 

C 

t: 

ccS 

.a, 

'a; 

C/3 

3 

O 

a. 



CJ 3 

cx o 
m >^ 

H <D 

§£•3 

0 5 -g 

1 o = 

^ J > 5^ 

‘ > > C/3 

*4 o w 

I ^ 

H x 

05 CJQ 
<! H 

> a 



o 

m 

NO 



z 

a 

< 



CJ 



o 

ON 

ON 

o' 



c/3 

LU 

D 

< 

> 



c 

o 



c 

<D 



ccS 

a. 



c 

o 

E 

"S 

o 

C/3 

V 

(U 

c 

t: o. 

CCS C/3 

CL g 

> S 

QJ ^ 
CCS 

C 



3 

Q ..2 

w "5 

1 - 2 
3 3 

0 IE 

a>. so 
u. c 

ccS ~ 

' 3 

ccS 



ccS 



H 

X 

ua 

H 

a 



3 

o 



on 

g 

> 



<D 

C/3 

3 

O 



ccS 

C 

£ 

o 



H x 

cc UJ 

< H 

> a 



vH 

05 

cv 



B o 
>- Z 



_ <N 



on 

g 

> 



o 

oa 



o 

ERIC 



oo 

o 



<u 



no 

On 



m 



ERjt 



x 

W 

H 

a 



u 



00 

g 

> 




on 

c 

a* 

> 

c/f 

CD 



«S 

CD 

>% 

C 

cC 

c 

o 




U 




o 

o 

o 



03 



OO 

W 

D 



<N 




£ 

•S 

T3 



CD CD 

t>Q c3 



W X. CD 

w : :e 



H 

QQ 

W 




o 



S o 
^ Z 



— <N 



00 

g 

> 



ON 

On 

ON 

ON 

ON 



1 2 : 

I CO 

' w 




00 

C75 

CM 



o 



C/3 

g 

> 



II 

C v) 
CD 

Oi 



V. . 



as 

o 



\D 

as 



m 



U 

uj 

I 

U 




$ 



Q 




S o 



— (N 



C/D 

s 

> 




1 C 

C?5 

C\J 



u 



c/d 

S 

> 



o 

ERIC 



Ph 



VO 

Os 



m 



ERiC 




d « 



U 



U 



(D O 

£ Z 



T3 

D 

CD 

cd 

D 

O 

ID 

-o 

C 

D 

u 

cd 

a. 



<N m 



GO 

§ 




O- 

D 



cd 

c 



c 

D 



cd 

CL. 



D 

4= 



3 

O 

D 

> 

cd 




U 



u 



C/5 

s 

> 



-o 

c 

cd 



-o 

-o 

cd 

c 

D 

i— 

u 

3 

L> 

d" 

E 

cd 

c 



c 

D 

u. 

cd 

CL. 




U 



u 



U O- 

I is 
> i 

cd c 
-c <u 
^ c 

• • >, 2 

w I & 

-) x 

“> UJ 

< H 

> a 



{>5 

g 

> 



o 

C?D. 

CM 



u 



u 



D 



D > C 
Q-L3 -X 



H 00 



D 

3 

.S 

’C* 

c 

O T3 
O D 
_ CD 

2 a 

_ D 
L- 

I 

S -2 
c 4 - 
pa <n 



— CN 

c/i 



$ 

> 



CD 

CD 

(M 



Uh 



vO 

On 



co 



c^- 

3 

O 



C/3 

c 

.2 

<D 

u 

C/3 

'c 



<u 

Cu 

C/3 

IE 



4= 



H 

X 

W 

H 

cy 



On 

Tf 

VO 




U 



c 

a 



03 

3 

do 

-2 

o3 

E 



c 

c3 



o3 

3 

00 



<D 

-3 



03 

E 

U« 

<D 

-C 



<u 

*5 

o 

u 



<D 

C/3 

3 

o 

Q- 



<D 

> 



o3 

a; 



Uh 

U 

W 

CU 

co 



-o 

C ~3 
<u r3 
J3 



<D 

-c 






^-(NrOTtvnvor^-ooav 

CO 



> 



(N 



> « 



a3 



U 



<3 o 
^ Z 



(N 



CO 

g 

4 

> 



O- 

<D 

E 

03 

C 

13 

-c 



H 

X 

w 

H 

cy 



x 

u 



co 

g 

> 



03 

03 

CVJ 



<u 



w pj: 



a 

Q 

§ 



X 

u 



co 

e 

a 

> 



00 

03 

CM 



O 

ERIC 



CN 




VO 

ON 



m 



rij oo 

J— * 



CJ 



CJ 



S o 
^ £ 



~ CN 

c/a 



> 



a 



u 



u 



C/5 

S 

> 



CN 

Cm 




CJ 



cj 



flj o 

> Z 



— CN 



in 

§ 

i 

> 



CJ 



CJ 



in 

§ 

=* 

> 




w 



2 <- 

CL iT) 

w vo 



►'"erj 

o 

oo 



CJ 



CJ 



in 

§ 

i 

> 



O 

o 



o 

ERIC 



NO 

ON 



m 



<D 






u 



VJ A 

o> o 

>■ z 



— <N 



go 

W 

D 



on 



£ Q 



a 



Pi o 






* 

U 



C/D 

g 

i 

> 




a 

JC 



U 



a> o 
^ 2 

^ CN 

in 

g 

i 

> 




S 2 



u 

u 



CO 

o 

CO 



GO 

g 

i 

> 



cv? 

o 

CO 



ERjt 



o 

ERsLC 



JX 

<u 



o 

13 

Uh 

,Q 



o 

c 

H 



* 

U 

LU 

DC 

O 



0 ) 

£ 



<u 

> 



VO 

ON 



m 



PQ 



00 

LU 

D 

< 

> 



HO 

o 

co 



< 3 * 

CD 

CO 



Baccalaureate and Beyond 
Field Test Report, 1996 



APPENDIX D 

Teaching Section Flow Chart 



O 

ERIC 



306 



B&B: 93/97 FIELD TEST 
TEACHING SECTION FLOW CHART 



Preload: TEACH 
ever taught, trained 
for, considered 
teaching? 




yes 



-yes- 



273: CERTVER 
'93 certification 
still correct? 



no 



278: CERTSCRN 
certified in add'l 
states? 



279: STCERT# 
-yes^| states currently 
certified in 



282: CERTST 
highest certification state 

i 

283: CERTMM 
date certificate issued 

i 

284: CERTK1ND 
certificate type 

x 



285: ALTCERT 
alternative certification? 



yes 

▼ 



259: TEACHEV 
ever taught? 




260: TCHTRNEV 




262: TCHCONEV 


ever trained to 


— no> 


ever considered 


teach? 




teaching? 


i 

yes 

▼ 


i 

yes 

X 


261: LEVELTRN 




263: LEVELCON 


level trained for 




level considered 



no 



not 

yes 



264: CERTNOW 
currently certified? 



T 

yes 



265: CERT 1 STM 
date 1st certified 



267: B4CERT 
taught before certified? 



-yes- 



268: B4BEG1NM 
start date? 



not yes 



270: B4ENDM 
end date 




286: ALTCERT2 
alternative certificate type 



287: OTHRCERT 
non-state certification 



288: LEVCERT 
level certified for 



-if CERTNOW yes- 



289: SUBCERT 
special subject certificate? 



if CERTNOW not yes 



292: FLDCER 
fields certified in 



-> 1 field- 



-no- 



o 

ERsLC 



1 field 

295: APPL1CAT 
# applications for 
teaching jobs 



293: BESTQUAL 
field best qualified 



Continued 
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May 1996 

[NAME] 

[ADDRESS] 

[CITY, STATE, ZIP] 

Dear [NAME]: 

In a few days, an interviewer from the National Opinion Research Center (NORC) at the University of Chicago 
will contact you by telephone to interview you. We would like to talk to you as part of the Baccalaureate and 
Beyond Study (B&B), sponsored by the U.S. Department of Education. As you may recall, you were interviewed 
for this study three years ago, as part of a sample of recent college graduates. The Department of Education is 
continuing this study in an effort to learn more about the choices college graduates make concerning work and 
the pursuit of further study. 

During the interview, we will ask you about some of the jobs you have held since your last interview, and any 
educational programs you have enrolled in since that time. The data we collect about your experiences in these 
areas are extremely valuable and influence the formation of education policy in the United States. 

Researchers, authorized by the Nadonal Center for Education Statistics (NCES), will combine your data with that 
of all others interviewed in this study to produce statistical reports for Congress and others. No individual data 
that links your name, address, telephone number, or student identification number with your responses is reported. 
Please see the back of this letter for information about our uncompromising pledge of confidentiality protection. 
New federal laws provide stiff fines and prison sentences for the disclosure of your identity or the misuse of 
information you provide to us. 

Our records indicate that your telephone number is [PHONE NUMBER], To update this information, or if you 
would like to arrange an interview at a time of your convenience, please call NORC toll-free (800-241-7357) or 
send E-mail (B&B2@norcmail.uchicago.edu). You may also contact the NORC Project Director, Dr. Patricia 
Green, at (312) 753-7325 with specific questions you have about the study or your interview. The enclosed leaflet 
contains more general information about the B&B study. Anyone wanting more information about NCES and 
the range of studies it conducts can access the NCES homepage on the Internet (//http/www. ed.gov/NCES). 

We thank you for your continuing participation and look forward to talking with you. 



Sincerely, 



Paula Knepper, Ph.D. 

Project Officer 

Postsecondary Longitudinal Studies 



Enel. 

[REPLICATE]-[CASE_ID]-[AQ_ID] 
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CONFIDENTIALITY ELEDfiE 

As a matter of policy, the National Opinion Research Center (NORC) and the National Center for 

Education Statistics (NCES), of the U.S. Department of Education, are concerned with protecting the privacy of 
individuals who participate in voluntary surveys. We want to let you know that: 

1 . The collection of information in this survey is authorized by Public Law 100-297 and continued under the 
auspices of Section 404(a) of the National Education Statistics Act of 1994, Tide IV of the Improving 
America’s Schools Act of 1994, Public Law 103-382. 

2. We are asking these questions in order to gather information about the experiences of college graduates 
after they leave college and move on to graduate or professional education, work, or other activities. 

3. Participation is voluntary. You may skip questions you do not wish to answer; however, we hope that you 
will answer as many questions as you can. 

4. No information collected under this authority may be used for any purpose other than the purpose for which 
it was supplied. Information will be protected from disclosure by federal statute (42 US Code 242m, 
section 308d). NCES may authorize only a limited number of researchers to have access to information 
which may identify individuals. They may use the data only for statistical purposes and are subject to fines 
and imprisonment for misuse. Data will be combined to produce statistical reports for Congress and others. 
No individual data that links your name, address, telephone number, or student identification number with 
your responses will be reported. 

5. All identifying information will be electronically separated from the survey data. Security provisions have 
been made for the storage of this information. Locator information will be supplied to NCES at completion 
of the survey for use in future follow-ups. 



According. to the Paperwork Reduction Act . of 1995,. no persons are. required to respond, to a collection of 
information unless it displays a valid OMB control number. The valid OMB control number for this 
information collection is 1850-0729. The ^ time: required to complete this information collection is estimated to 
average 40 minutes per response, includingthetirneto review: instructions, search existing, dat&resources, 
gather the data needed, and complete and review the: information collected. If you have any comments 
concerning the accuracy of the time estimate or suggestions for improving the survey iratrument; please write 
to:. U.S. Department of Education, Washington. D.C. 20202-4651. If you have comments or concerns 
regarding the status of your individual response to this: survey; write directly to:: National Center for Education 
Statistics. 555 New Jersey Avenue. N.W., Washington, D.C. 20208 
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